Apr 14 05:41:53 user nova-compute[71312]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 05:41:56 user nova-compute[71312]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71312) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71312) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71312) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 05:41:56 user nova-compute[71312]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:41:56 user nova-compute[71312]: INFO nova.virt.driver [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 05:41:56 user nova-compute[71312]: INFO nova.compute.provider_config [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] Acquiring lock "singleton_lock" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] Acquired lock "singleton_lock" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] Releasing lock "singleton_lock" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] Full set of CONF: {{(pid=71312) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ******************************************************************************** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] Configuration options gathered from: {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 05:41:56 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ================================================================================ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] allow_resize_to_same_host      = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] arq_binding_timeout            = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] backdoor_port                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] backdoor_socket                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] block_device_allocate_retries  = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] block_device_allocate_retries_interval = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cert                           = self.pem {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute_monitors               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] config_dir                     = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] config_drive_format            = iso9660 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] config_source                  = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] console_host                   = user {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] control_exchange               = nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cpu_allocation_ratio           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] daemon                         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] debug                          = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] default_access_ip_network_name = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] default_availability_zone      = nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] default_ephemeral_format       = ext4 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] default_schedule_zone          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] disk_allocation_ratio          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] enable_new_services            = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] enabled_apis                   = ['osapi_compute'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] enabled_ssl_apis               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] flat_injected                  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] force_config_drive             = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] force_raw_images               = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] graceful_shutdown_timeout      = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] heal_instance_info_cache_interval = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] host                           = user {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] instance_build_timeout         = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] instance_delete_interval       = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] instance_format                = [instance: %(uuid)s]  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] instance_name_template         = instance-%08x {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] instance_usage_audit           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] instance_usage_audit_period    = month {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] internal_service_availability_zone = internal {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] key                            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] live_migration_retry_count     = 30 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] log_config_append              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] log_dir                        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] log_file                       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] log_options                    = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] log_rotate_interval            = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] log_rotate_interval_type       = days {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] log_rotation_type              = none {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] long_rpc_timeout               = 1800 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] max_concurrent_builds          = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] max_concurrent_live_migrations = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] max_concurrent_snapshots       = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] max_local_block_devices        = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] max_logfile_count              = 30 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] max_logfile_size_mb            = 200 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] maximum_instance_delete_attempts = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] metadata_listen                = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] metadata_listen_port           = 8775 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] metadata_workers               = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] migrate_max_retries            = -1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] mkisofs_cmd                    = genisoimage {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] my_ip                          = 10.0.0.210 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] network_allocate_retries       = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] osapi_compute_listen_port      = 8774 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] osapi_compute_unique_server_name_scope =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] osapi_compute_workers          = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] password_length                = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] periodic_enable                = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] periodic_fuzzy_delay           = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] pointer_model                  = ps2mouse {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] preallocate_images             = none {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] publish_errors                 = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] pybasedir                      = /opt/stack/nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ram_allocation_ratio           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] rate_limit_burst               = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] rate_limit_except_level        = CRITICAL {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] rate_limit_interval            = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] reboot_timeout                 = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] reclaim_instance_interval      = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] record                         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] reimage_timeout_per_gb         = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] report_interval                = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] rescue_timeout                 = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] reserved_host_cpus             = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] reserved_host_disk_mb          = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] reserved_host_memory_mb        = 512 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] reserved_huge_pages            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] resize_confirm_window          = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] resize_fs_using_block_device   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] resume_guests_state_on_host_boot = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] rpc_response_timeout           = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] run_external_periodic_tasks    = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] running_deleted_instance_action = reap {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] running_deleted_instance_poll_interval = 1800 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] running_deleted_instance_timeout = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler_instance_sync_interval = 120 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_down_time              = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] servicegroup_driver            = db {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] shelved_offload_time           = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] shelved_poll_interval          = 3600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] shutdown_timeout               = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] source_is_ipv6                 = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ssl_only                       = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] state_path                     = /opt/stack/data/nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] sync_power_state_interval      = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] sync_power_state_pool_size     = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] syslog_log_facility            = LOG_USER {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] tempdir                        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] timeout_nbd                    = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] transport_url                  = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] update_resources_interval      = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] use_cow_images                 = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] use_eventlog                   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] use_journal                    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] use_json                       = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] use_rootwrap_daemon            = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] use_stderr                     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] use_syslog                     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vcpu_pin_set                   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plugging_is_fatal          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plugging_timeout           = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] virt_mkfs                      = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] volume_usage_poll_interval     = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] watch_log_file                 = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] web                            = /usr/share/spice-html5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_concurrency.disable_process_locking = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.auth_strategy              = keystone {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.compute_link_prefix        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.dhcp_domain                = novalocal {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.enable_instance_password   = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.glance_link_prefix         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.instance_list_per_project_cells = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.list_records_by_skipping_down_cells = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.local_metadata_per_cell    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.max_limit                  = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.metadata_cache_expiration  = 15 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.neutron_default_tenant_id  = default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.use_forwarded_for          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.use_neutron_default_nets   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.vendordata_dynamic_targets = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.vendordata_jsonfile_path   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.backend                  = dogpile.cache.memcached {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.backend_argument         = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.config_prefix            = cache.oslo {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.dead_timeout             = 60.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.debug_cache_backend      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.enable_retry_client      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.enable_socket_keepalive  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.enabled                  = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.expiration_time          = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.hashclient_retry_attempts = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_dead_retry      = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_password        =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_pool_maxsize    = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_sasl_enabled    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.memcache_username        =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.proxies                  = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.retry_attempts           = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.retry_delay              = 0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.socket_keepalive_count   = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.socket_keepalive_idle    = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.socket_keepalive_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.tls_allowed_ciphers      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.tls_cafile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.tls_certfile             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.tls_enabled              = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cache.tls_keyfile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.auth_section            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.auth_type               = password {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.cafile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.certfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.collect_timing          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.cross_az_attach         = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.debug                   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.endpoint_template       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.http_retries            = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.keyfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.os_region_name          = RegionOne {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.split_loggers           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cinder.timeout                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.cpu_dedicated_set      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.cpu_shared_set         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.image_type_exclude_list = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.max_concurrent_disk_ops = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.max_disk_devices_to_attach = -1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.resource_provider_association_refresh = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.shutdown_retry_interval = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] conductor.workers              = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] console.allowed_origins        = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] console.ssl_ciphers            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] console.ssl_minimum_version    = default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] consoleauth.token_ttl          = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.cafile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.certfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.collect_timing          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.connect_retries         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.connect_retry_delay     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.endpoint_override       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.keyfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.max_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.min_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.region_name             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.service_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.service_type            = accelerator {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.split_loggers           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.status_code_retries     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.timeout                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] cyborg.version                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.backend               = sqlalchemy {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.connection            = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.connection_debug      = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.connection_parameters =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.connection_recycle_time = 3600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.connection_trace      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.db_inc_retry_interval = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.db_max_retries        = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.db_max_retry_interval = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.db_retry_interval     = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.max_overflow          = 50 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.max_pool_size         = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.max_retries           = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.mysql_enable_ndb      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.mysql_wsrep_sync_wait = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.pool_timeout          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.retry_interval        = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.slave_connection      = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] database.sqlite_synchronous    = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.backend           = sqlalchemy {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.connection        = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.connection_debug  = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.connection_parameters =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.connection_recycle_time = 3600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.connection_trace  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.db_inc_retry_interval = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.db_max_retries    = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.db_max_retry_interval = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.db_retry_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.max_overflow      = 50 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.max_pool_size     = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.max_retries       = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.mysql_enable_ndb  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.pool_timeout      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.retry_interval    = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.slave_connection  = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] api_database.sqlite_synchronous = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] devices.enabled_mdev_types     = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ephemeral_storage_encryption.enabled = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.api_servers             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.cafile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.certfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.collect_timing          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.connect_retries         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.connect_retry_delay     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.debug                   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.default_trusted_certificate_ids = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.enable_certificate_validation = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.enable_rbd_download     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.endpoint_override       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.keyfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.max_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.min_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.num_retries             = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.rbd_ceph_conf           =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.rbd_connect_timeout     = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.rbd_pool                =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.rbd_user                =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.region_name             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.service_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.service_type            = image {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.split_loggers           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.status_code_retries     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.timeout                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.verify_glance_signatures = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] glance.version                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] guestfs.debug                  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.config_drive_cdrom      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.config_drive_inject_password = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.enable_instance_metrics_collection = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.enable_remotefx         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.instances_path_share    =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.iscsi_initiator_list    = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.limit_cpu_features      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.power_state_check_timeframe = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.use_multipath_io        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.volume_attach_retry_count = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.vswitch_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] mks.enabled                    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] image_cache.manager_interval   = 2400 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] image_cache.precache_concurrency = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] image_cache.remove_unused_base_images = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] image_cache.subdirectory_name  = _base {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.api_max_retries         = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.api_retry_interval      = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.auth_section            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.auth_type               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.cafile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.certfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.collect_timing          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.connect_retries         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.connect_retry_delay     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.endpoint_override       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.keyfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.max_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.min_version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.partition_key           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.peer_list               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.region_name             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.serial_console_state_timeout = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.service_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.service_type            = baremetal {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.split_loggers           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.status_code_retries     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.timeout                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ironic.version                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] key_manager.fixed_key          = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.barbican_api_version  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.barbican_endpoint     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.barbican_endpoint_type = public {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.barbican_region_name  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.cafile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.certfile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.collect_timing        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.insecure              = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.keyfile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.number_of_retries     = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.retry_delay           = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.send_service_user_token = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.split_loggers         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.timeout               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.verify_ssl            = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican.verify_ssl_path       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.auth_section = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.auth_type = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.cafile   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.certfile = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.collect_timing = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.insecure = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.keyfile  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.split_loggers = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] barbican_service_user.timeout  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.approle_role_id          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.approle_secret_id        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.cafile                   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.certfile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.collect_timing           = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.insecure                 = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.keyfile                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.kv_mountpoint            = secret {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.kv_version               = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.namespace                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.root_token_id            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.split_loggers            = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.ssl_ca_crt_file          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.timeout                  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.use_ssl                  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.cafile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.certfile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.collect_timing        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.connect_retries       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.connect_retry_delay   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.endpoint_override     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.insecure              = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.keyfile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.max_version           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.min_version           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.region_name           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.service_name          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.service_type          = identity {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.split_loggers         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.status_code_retries   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.timeout               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] keystone.version               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.connection_uri         =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.cpu_mode               = custom {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: WARNING oslo_config.cfg [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.cpu_power_governor_high = performance {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.cpu_power_governor_low = powersave {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.cpu_power_management   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.device_detach_attempts = 8 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.device_detach_timeout  = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.disk_cachemodes        = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.disk_prefix            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.enabled_perf_events    = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.file_backed_memory     = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.gid_maps               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.hw_disk_discard        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.hw_machine_type        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.images_rbd_glance_store_name =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.images_rbd_pool        = rbd {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.images_type            = default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.images_volume_group    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.inject_key             = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.inject_partition       = -2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.inject_password        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.iscsi_iface            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.iser_use_multipath     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_bandwidth = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_downtime = 500 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_inbound_addr = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_permit_post_copy = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_scheme  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_timeout_action = abort {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_tunnelled = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: WARNING oslo_config.cfg [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 05:41:57 user nova-compute[71312]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 05:41:57 user nova-compute[71312]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 05:41:57 user nova-compute[71312]: and ``live_migration_inbound_addr`` respectively.
Apr 14 05:41:57 user nova-compute[71312]: ).  Its value may be silently ignored in the future.
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.live_migration_with_native_tls = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.max_queues             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.nfs_mount_options      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.num_memory_encrypted_guests = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.num_pcie_ports         = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.pmem_namespaces        = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.quobyte_client_cfg     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rbd_secret_uuid        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rbd_user               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.remote_filesystem_transport = ssh {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rescue_image_id        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rescue_kernel_id       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rescue_ramdisk_id      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.rx_queue_size          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.smbfs_mount_options    =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.snapshot_compression   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.snapshot_image_format  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.sparse_logical_volumes = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.swtpm_enabled          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.swtpm_group            = tss {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.swtpm_user             = tss {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.sysinfo_serial         = unique {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.tx_queue_size          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.uid_maps               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.use_virtio_for_bridges = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.virt_type              = kvm {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.volume_clear           = zero {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.volume_clear_size      = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.volume_use_multipath   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.vzstorage_cache_path   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.vzstorage_mount_user   = stack {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.auth_section           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.auth_type              = password {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.cafile                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.certfile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.collect_timing         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.connect_retries        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.connect_retry_delay    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.default_floating_pool  = public {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.endpoint_override      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.extension_sync_interval = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.http_retries           = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.insecure               = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.keyfile                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.max_version            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.min_version            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.ovs_bridge             = br-int {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.physnets               = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.region_name            = RegionOne {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.service_metadata_proxy = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.service_name           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.service_type           = network {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.split_loggers          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.status_code_retries    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.timeout                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] neutron.version                = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] notifications.bdms_in_notifications = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] notifications.default_level    = INFO {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] notifications.notification_format = unversioned {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] notifications.notify_on_state_change = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] pci.alias                      = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] pci.device_spec                = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] pci.report_in_placement        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.auth_section         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.auth_type            = password {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.cafile               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.certfile             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.collect_timing       = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.connect_retries      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.connect_retry_delay  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.default_domain_id    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.default_domain_name  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.domain_id            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.domain_name          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.endpoint_override    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.insecure             = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.keyfile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.max_version          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.min_version          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.password             = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.project_domain_id    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.project_domain_name  = Default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.project_id           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.project_name         = service {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.region_name          = RegionOne {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.service_name         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.service_type         = placement {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.split_loggers        = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.status_code_retries  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.system_scope         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.timeout              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.trust_id             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.user_domain_id       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.user_domain_name     = Default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.user_id              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.username             = placement {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] placement.version              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.cores                    = 20 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.count_usage_from_placement = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.injected_file_content_bytes = 10240 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.injected_file_path_length = 255 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.injected_files           = 5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.instances                = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.key_pairs                = 100 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.metadata_items           = 128 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.ram                      = 51200 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.recheck_quota            = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.server_group_members     = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] quota.server_groups            = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] rdp.enabled                    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.image_metadata_prefilter = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.max_attempts         = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.max_placement_results = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.query_placement_for_availability_zone = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.query_placement_for_image_type_support = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] scheduler.workers              = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.host_subset_size = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.isolated_hosts = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.isolated_images = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.pci_in_placement = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.track_instance_changes = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] metrics.required               = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] metrics.weight_multiplier      = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] metrics.weight_setting         = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] serial_console.enabled         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] serial_console.port_range      = 10000:20000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] serial_console.serialproxy_port = 6083 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.auth_section      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.auth_type         = password {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.cafile            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.certfile          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.collect_timing    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.insecure          = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.keyfile           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.send_service_user_token = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.split_loggers     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] service_user.timeout           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.agent_enabled            = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.enabled                  = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.html5proxy_port          = 6082 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.image_compression        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.jpeg_compression         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.playback_compression     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.server_listen            = 127.0.0.1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.streaming_mode           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] spice.zlib_compression         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] upgrade_levels.baseapi         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] upgrade_levels.cert            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] upgrade_levels.compute         = auto {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] upgrade_levels.conductor       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] upgrade_levels.scheduler       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.auth_section = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.auth_type = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.cafile = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.certfile = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.insecure = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.keyfile = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vendordata_dynamic_auth.timeout = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.api_retry_count         = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.ca_file                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.cache_prefix            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.cluster_name            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.connection_pool_size    = 10 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.console_delay_seconds   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.datastore_regex         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.host_ip                 = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.host_password           = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.host_port               = 443 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.host_username           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.insecure                = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.integration_bridge      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.maximum_objects         = 100 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.pbm_default_policy      = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.pbm_enabled             = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.pbm_wsdl_location       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.serial_port_proxy_uri   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.serial_port_service_uri = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.task_poll_interval      = 0.5 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.use_linked_clone        = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.vnc_keymap              = en-us {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.vnc_port                = 5900 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vmware.vnc_port_total          = 10000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.auth_schemes               = ['none'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.enabled                    = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.novncproxy_port            = 6080 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.server_listen              = 0.0.0.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.vencrypt_ca_certs          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.vencrypt_client_cert       = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vnc.vencrypt_client_key        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.disable_rootwrap   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.enable_numa_live_migration = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.libvirt_disable_apic = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.client_socket_timeout     = 900 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.default_pool_size         = 1000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.keep_alive                = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.max_header_line           = 16384 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.ssl_ca_file               = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.ssl_cert_file             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.ssl_key_file              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.tcp_keepidle              = 600 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] zvm.ca_file                    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] zvm.cloud_connector_url        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] zvm.reachable_timeout          = 300 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.enforce_new_defaults = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.enforce_scope      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.policy_default_rule = default {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.policy_file        = policy.yaml {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.connection_string     = messaging:// {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.enabled               = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.es_doc_type           = notification {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.es_scroll_size        = 10000 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.es_scroll_time        = 2m {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.filter_error_trace    = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.sentinel_service_name = mymaster {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.socket_timeout        = 0.1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] profiler.trace_sqlalchemy      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] remote_debug.host              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] remote_debug.port              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.ssl      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_notifications.retry = -1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_messaging_notifications.transport_url = **** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.auth_section        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.auth_type           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.cafile              = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.certfile            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.collect_timing      = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.connect_retries     = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.connect_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.endpoint_id         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.endpoint_override   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.insecure            = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.keyfile             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.max_version         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.min_version         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.region_name         = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.service_name        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.service_type        = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.split_loggers       = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.status_code_retries = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.status_code_retry_delay = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.timeout             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.valid_interfaces    = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_limit.version             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_reports.file_event_handler = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] oslo_reports.log_dir           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_ovs_privileged.group  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] vif_plug_ovs_privileged.user   = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_linux_bridge.flat_interface = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_ovs.isolate_vif         = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_vif_ovs.per_port_bridge     = False {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] os_brick.lock_path             = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] privsep_osbrick.capabilities   = [21] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] privsep_osbrick.group          = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] privsep_osbrick.helper_command = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] privsep_osbrick.user           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] nova_sys_admin.group           = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] nova_sys_admin.helper_command  = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] nova_sys_admin.user            = None {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG oslo_service.service [None req-9a3d589f-7151-4b1f-be0c-d24b5a05fe6c None None] ******************************************************************************** {{(pid=71312) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 05:41:57 user nova-compute[71312]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 05:41:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Starting native event thread {{(pid=71312) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Starting green dispatch thread {{(pid=71312) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Starting connection event dispatch thread {{(pid=71312) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Connecting to libvirt: qemu:///system {{(pid=71312) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f49e62b6620> {{(pid=71312) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 05:41:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f49e62b6620> {{(pid=71312) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 05:41:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Connection event '1' reason 'None'
Apr 14 05:41:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 05:41:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.mount [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Initialising _HostMountState generation 0 {{(pid=71312) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 05:42:04 user nova-compute[71312]: INFO nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host capabilities <capabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <host>
Apr 14 05:42:04 user nova-compute[71312]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 05:42:04 user nova-compute[71312]:     <cpu>
Apr 14 05:42:04 user nova-compute[71312]:       <arch>x86_64</arch>
Apr 14 05:42:04 user nova-compute[71312]:       <model>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <microcode version='1070'/>
Apr 14 05:42:04 user nova-compute[71312]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 05:42:04 user nova-compute[71312]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='osxsave'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='invtsc'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='rsba'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 05:42:04 user nova-compute[71312]:       <pages unit='KiB' size='4'/>
Apr 14 05:42:04 user nova-compute[71312]:       <pages unit='KiB' size='2048'/>
Apr 14 05:42:04 user nova-compute[71312]:     </cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <power_management>
Apr 14 05:42:04 user nova-compute[71312]:       <suspend_mem/>
Apr 14 05:42:04 user nova-compute[71312]:       <suspend_disk/>
Apr 14 05:42:04 user nova-compute[71312]:       <suspend_hybrid/>
Apr 14 05:42:04 user nova-compute[71312]:     </power_management>
Apr 14 05:42:04 user nova-compute[71312]:     <iommu support='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <migration_features>
Apr 14 05:42:04 user nova-compute[71312]:       <live/>
Apr 14 05:42:04 user nova-compute[71312]:       <uri_transports>
Apr 14 05:42:04 user nova-compute[71312]:         <uri_transport>tcp</uri_transport>
Apr 14 05:42:04 user nova-compute[71312]:         <uri_transport>rdma</uri_transport>
Apr 14 05:42:04 user nova-compute[71312]:       </uri_transports>
Apr 14 05:42:04 user nova-compute[71312]:     </migration_features>
Apr 14 05:42:04 user nova-compute[71312]:     <topology>
Apr 14 05:42:04 user nova-compute[71312]:       <cells num='2'>
Apr 14 05:42:04 user nova-compute[71312]:         <cell id='0'>
Apr 14 05:42:04 user nova-compute[71312]:           <memory unit='KiB'>8152920</memory>
Apr 14 05:42:04 user nova-compute[71312]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 14 05:42:04 user nova-compute[71312]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 05:42:04 user nova-compute[71312]:           <distances>
Apr 14 05:42:04 user nova-compute[71312]:             <sibling id='0' value='10'/>
Apr 14 05:42:04 user nova-compute[71312]:             <sibling id='1' value='20'/>
Apr 14 05:42:04 user nova-compute[71312]:           </distances>
Apr 14 05:42:04 user nova-compute[71312]:           <cpus num='6'>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 05:42:04 user nova-compute[71312]:           </cpus>
Apr 14 05:42:04 user nova-compute[71312]:         </cell>
Apr 14 05:42:04 user nova-compute[71312]:         <cell id='1'>
Apr 14 05:42:04 user nova-compute[71312]:           <memory unit='KiB'>8255068</memory>
Apr 14 05:42:04 user nova-compute[71312]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 14 05:42:04 user nova-compute[71312]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 05:42:04 user nova-compute[71312]:           <distances>
Apr 14 05:42:04 user nova-compute[71312]:             <sibling id='0' value='20'/>
Apr 14 05:42:04 user nova-compute[71312]:             <sibling id='1' value='10'/>
Apr 14 05:42:04 user nova-compute[71312]:           </distances>
Apr 14 05:42:04 user nova-compute[71312]:           <cpus num='6'>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 05:42:04 user nova-compute[71312]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 05:42:04 user nova-compute[71312]:           </cpus>
Apr 14 05:42:04 user nova-compute[71312]:         </cell>
Apr 14 05:42:04 user nova-compute[71312]:       </cells>
Apr 14 05:42:04 user nova-compute[71312]:     </topology>
Apr 14 05:42:04 user nova-compute[71312]:     <cache>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 05:42:04 user nova-compute[71312]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 05:42:04 user nova-compute[71312]:     </cache>
Apr 14 05:42:04 user nova-compute[71312]:     <secmodel>
Apr 14 05:42:04 user nova-compute[71312]:       <model>apparmor</model>
Apr 14 05:42:04 user nova-compute[71312]:       <doi>0</doi>
Apr 14 05:42:04 user nova-compute[71312]:     </secmodel>
Apr 14 05:42:04 user nova-compute[71312]:     <secmodel>
Apr 14 05:42:04 user nova-compute[71312]:       <model>dac</model>
Apr 14 05:42:04 user nova-compute[71312]:       <doi>0</doi>
Apr 14 05:42:04 user nova-compute[71312]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 05:42:04 user nova-compute[71312]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 05:42:04 user nova-compute[71312]:     </secmodel>
Apr 14 05:42:04 user nova-compute[71312]:   </host>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='alpha'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>clipper</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='armv6l'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>spitz</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>nuri</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>kzm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sx1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>z2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>tosa</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>n810</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>n800</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>terrier</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>midway</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>microbit</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>verdex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>highbank</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>akita</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>connex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>collie</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='armv7l'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>spitz</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>nuri</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>kzm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sx1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>z2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>tosa</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>n810</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>n800</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>terrier</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>midway</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>microbit</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>verdex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>highbank</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>akita</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>connex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>collie</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='aarch64'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>spitz</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>nuri</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>kzm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sx1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>z2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>tosa</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>n810</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>n800</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>terrier</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>midway</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>microbit</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>verdex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>highbank</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>akita</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>connex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>collie</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <acpi default='on' toggle='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='cris'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='i686'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>isapc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>microvm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='kvm'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <pae/>
Apr 14 05:42:04 user nova-compute[71312]:       <nonpae/>
Apr 14 05:42:04 user nova-compute[71312]:       <acpi default='on' toggle='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:       <apic default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='m68k'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>an5206</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>q800</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='microblaze'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='microblazeel'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='mips'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='16'>malta</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='mipsel'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='16'>malta</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='mips64'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='16'>malta</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>pica61</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>magnum</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='mips64el'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='16'>malta</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>pica61</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>magnum</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='16'>boston</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='ppc'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mac99</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>40p</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>taihu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='ppc64'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>taihu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>40p</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mac99</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='ppc64le'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>taihu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>40p</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>mac99</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='riscv32'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='8'>spike</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='8'>virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='riscv64'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='8'>spike</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='8'>virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='s390x'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='sh4'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>shix</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>r2d</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='sh4eb'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>shix</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>r2d</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='sparc'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>LX</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='sparc64'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>niagara</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='x86_64'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>64</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='1'>isapc</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>microvm</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='kvm'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <acpi default='on' toggle='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:       <apic default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='xtensa'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>sim</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>kc705</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>ml605</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>lx200</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>lx60</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]:   <guest>
Apr 14 05:42:04 user nova-compute[71312]:     <os_type>hvm</os_type>
Apr 14 05:42:04 user nova-compute[71312]:     <arch name='xtensaeb'>
Apr 14 05:42:04 user nova-compute[71312]:       <wordsize>32</wordsize>
Apr 14 05:42:04 user nova-compute[71312]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='4'>sim</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>kc705</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>ml605</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>virt</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>lx200</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>lx60</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 05:42:04 user nova-compute[71312]:       <domain type='qemu'/>
Apr 14 05:42:04 user nova-compute[71312]:     </arch>
Apr 14 05:42:04 user nova-compute[71312]:     <features>
Apr 14 05:42:04 user nova-compute[71312]:       <cpuselection/>
Apr 14 05:42:04 user nova-compute[71312]:       <deviceboot/>
Apr 14 05:42:04 user nova-compute[71312]:       <disksnapshot default='on' toggle='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     </features>
Apr 14 05:42:04 user nova-compute[71312]:   </guest>
Apr 14 05:42:04 user nova-compute[71312]: </capabilities>
Apr 14 05:42:04 user nova-compute[71312]: 
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 05:42:04 user nova-compute[71312]: <domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 05:42:04 user nova-compute[71312]:   <domain>kvm</domain>
Apr 14 05:42:04 user nova-compute[71312]:   <machine>pc-i440fx-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:   <arch>i686</arch>
Apr 14 05:42:04 user nova-compute[71312]:   <vcpu max='255'/>
Apr 14 05:42:04 user nova-compute[71312]:   <iothreads supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:   <os supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='firmware'/>
Apr 14 05:42:04 user nova-compute[71312]:     <loader supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>rom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pflash</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='readonly'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='secure'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </loader>
Apr 14 05:42:04 user nova-compute[71312]:   </os>
Apr 14 05:42:04 user nova-compute[71312]:   <cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='maximumMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='lm'/>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>phenom</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>n270</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>kvm64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>core2duo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>athlon</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Westmere</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Penryn</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G1</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Conroe</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>486</model>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:   </cpu>
Apr 14 05:42:04 user nova-compute[71312]:   <memoryBacking supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='sourceType'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>file</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>anonymous</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>memfd</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:   </memoryBacking>
Apr 14 05:42:04 user nova-compute[71312]:   <devices>
Apr 14 05:42:04 user nova-compute[71312]:     <disk supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='diskDevice'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>disk</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cdrom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>floppy</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>lun</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='bus'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ide</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>fdc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sata</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </disk>
Apr 14 05:42:04 user nova-compute[71312]:     <graphics supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sdl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vnc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>spice</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egl-headless</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </graphics>
Apr 14 05:42:04 user nova-compute[71312]:     <video supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='modelType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cirrus</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vmvga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>qxl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>none</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>bochs</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ramfb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </video>
Apr 14 05:42:04 user nova-compute[71312]:     <hostdev supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='mode'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>subsystem</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='startupPolicy'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>default</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>mandatory</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>requisite</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>optional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='subsysType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pci</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='capsType'/>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='pciBackend'/>
Apr 14 05:42:04 user nova-compute[71312]:     </hostdev>
Apr 14 05:42:04 user nova-compute[71312]:     <rng supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>random</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egd</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>builtin</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </rng>
Apr 14 05:42:04 user nova-compute[71312]:     <filesystem supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='driverType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>path</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>handle</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtiofs</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </filesystem>
Apr 14 05:42:04 user nova-compute[71312]:     <tpm supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-tis</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-crb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>passthrough</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>emulator</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </tpm>
Apr 14 05:42:04 user nova-compute[71312]:   </devices>
Apr 14 05:42:04 user nova-compute[71312]:   <features>
Apr 14 05:42:04 user nova-compute[71312]:     <gic supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <genid supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backup supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <sev supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:   </features>
Apr 14 05:42:04 user nova-compute[71312]: </domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 05:42:04 user nova-compute[71312]: <domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 05:42:04 user nova-compute[71312]:   <domain>kvm</domain>
Apr 14 05:42:04 user nova-compute[71312]:   <machine>pc-q35-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:   <arch>i686</arch>
Apr 14 05:42:04 user nova-compute[71312]:   <vcpu max='288'/>
Apr 14 05:42:04 user nova-compute[71312]:   <iothreads supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:   <os supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='firmware'/>
Apr 14 05:42:04 user nova-compute[71312]:     <loader supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>rom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pflash</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='readonly'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='secure'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </loader>
Apr 14 05:42:04 user nova-compute[71312]:   </os>
Apr 14 05:42:04 user nova-compute[71312]:   <cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='maximumMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='lm'/>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>phenom</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>n270</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>kvm64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>core2duo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>athlon</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Westmere</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Penryn</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G1</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Conroe</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>486</model>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:   </cpu>
Apr 14 05:42:04 user nova-compute[71312]:   <memoryBacking supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='sourceType'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>file</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>anonymous</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>memfd</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:   </memoryBacking>
Apr 14 05:42:04 user nova-compute[71312]:   <devices>
Apr 14 05:42:04 user nova-compute[71312]:     <disk supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='diskDevice'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>disk</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cdrom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>floppy</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>lun</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='bus'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>fdc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sata</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </disk>
Apr 14 05:42:04 user nova-compute[71312]:     <graphics supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sdl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vnc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>spice</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egl-headless</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </graphics>
Apr 14 05:42:04 user nova-compute[71312]:     <video supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='modelType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cirrus</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vmvga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>qxl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>none</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>bochs</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ramfb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </video>
Apr 14 05:42:04 user nova-compute[71312]:     <hostdev supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='mode'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>subsystem</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='startupPolicy'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>default</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>mandatory</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>requisite</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>optional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='subsysType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pci</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='capsType'/>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='pciBackend'/>
Apr 14 05:42:04 user nova-compute[71312]:     </hostdev>
Apr 14 05:42:04 user nova-compute[71312]:     <rng supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>random</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egd</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>builtin</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </rng>
Apr 14 05:42:04 user nova-compute[71312]:     <filesystem supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='driverType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>path</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>handle</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtiofs</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </filesystem>
Apr 14 05:42:04 user nova-compute[71312]:     <tpm supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-tis</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-crb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>passthrough</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>emulator</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </tpm>
Apr 14 05:42:04 user nova-compute[71312]:   </devices>
Apr 14 05:42:04 user nova-compute[71312]:   <features>
Apr 14 05:42:04 user nova-compute[71312]:     <gic supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <genid supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backup supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <sev supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:   </features>
Apr 14 05:42:04 user nova-compute[71312]: </domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 05:42:04 user nova-compute[71312]: <domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 05:42:04 user nova-compute[71312]:   <domain>kvm</domain>
Apr 14 05:42:04 user nova-compute[71312]:   <machine>pc-i440fx-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:   <arch>i686</arch>
Apr 14 05:42:04 user nova-compute[71312]:   <vcpu max='255'/>
Apr 14 05:42:04 user nova-compute[71312]:   <iothreads supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:   <os supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='firmware'/>
Apr 14 05:42:04 user nova-compute[71312]:     <loader supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>rom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pflash</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='readonly'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='secure'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </loader>
Apr 14 05:42:04 user nova-compute[71312]:   </os>
Apr 14 05:42:04 user nova-compute[71312]:   <cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='maximumMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='lm'/>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>phenom</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>n270</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>kvm64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>core2duo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>athlon</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Westmere</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Penryn</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G1</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Conroe</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>486</model>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:   </cpu>
Apr 14 05:42:04 user nova-compute[71312]:   <memoryBacking supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='sourceType'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>file</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>anonymous</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>memfd</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:   </memoryBacking>
Apr 14 05:42:04 user nova-compute[71312]:   <devices>
Apr 14 05:42:04 user nova-compute[71312]:     <disk supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='diskDevice'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>disk</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cdrom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>floppy</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>lun</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='bus'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ide</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>fdc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sata</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </disk>
Apr 14 05:42:04 user nova-compute[71312]:     <graphics supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sdl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vnc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>spice</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egl-headless</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </graphics>
Apr 14 05:42:04 user nova-compute[71312]:     <video supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='modelType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cirrus</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vmvga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>qxl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>none</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>bochs</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ramfb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </video>
Apr 14 05:42:04 user nova-compute[71312]:     <hostdev supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='mode'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>subsystem</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='startupPolicy'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>default</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>mandatory</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>requisite</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>optional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='subsysType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pci</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='capsType'/>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='pciBackend'/>
Apr 14 05:42:04 user nova-compute[71312]:     </hostdev>
Apr 14 05:42:04 user nova-compute[71312]:     <rng supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>random</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egd</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>builtin</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </rng>
Apr 14 05:42:04 user nova-compute[71312]:     <filesystem supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='driverType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>path</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>handle</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtiofs</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </filesystem>
Apr 14 05:42:04 user nova-compute[71312]:     <tpm supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-tis</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-crb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>passthrough</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>emulator</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </tpm>
Apr 14 05:42:04 user nova-compute[71312]:   </devices>
Apr 14 05:42:04 user nova-compute[71312]:   <features>
Apr 14 05:42:04 user nova-compute[71312]:     <gic supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <genid supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backup supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <sev supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:   </features>
Apr 14 05:42:04 user nova-compute[71312]: </domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 05:42:04 user nova-compute[71312]: <domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 05:42:04 user nova-compute[71312]:   <domain>kvm</domain>
Apr 14 05:42:04 user nova-compute[71312]:   <machine>pc-q35-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:   <arch>i686</arch>
Apr 14 05:42:04 user nova-compute[71312]:   <vcpu max='288'/>
Apr 14 05:42:04 user nova-compute[71312]:   <iothreads supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:   <os supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='firmware'/>
Apr 14 05:42:04 user nova-compute[71312]:     <loader supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>rom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pflash</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='readonly'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='secure'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </loader>
Apr 14 05:42:04 user nova-compute[71312]:   </os>
Apr 14 05:42:04 user nova-compute[71312]:   <cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='maximumMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='lm'/>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>phenom</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>n270</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>kvm64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>core2duo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>athlon</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Westmere</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Penryn</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G1</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Conroe</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>486</model>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:   </cpu>
Apr 14 05:42:04 user nova-compute[71312]:   <memoryBacking supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='sourceType'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>file</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>anonymous</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>memfd</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:   </memoryBacking>
Apr 14 05:42:04 user nova-compute[71312]:   <devices>
Apr 14 05:42:04 user nova-compute[71312]:     <disk supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='diskDevice'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>disk</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cdrom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>floppy</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>lun</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='bus'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>fdc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sata</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </disk>
Apr 14 05:42:04 user nova-compute[71312]:     <graphics supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sdl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vnc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>spice</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egl-headless</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </graphics>
Apr 14 05:42:04 user nova-compute[71312]:     <video supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='modelType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cirrus</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vmvga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>qxl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>none</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>bochs</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ramfb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </video>
Apr 14 05:42:04 user nova-compute[71312]:     <hostdev supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='mode'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>subsystem</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='startupPolicy'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>default</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>mandatory</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>requisite</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>optional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='subsysType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pci</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='capsType'/>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='pciBackend'/>
Apr 14 05:42:04 user nova-compute[71312]:     </hostdev>
Apr 14 05:42:04 user nova-compute[71312]:     <rng supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>random</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egd</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>builtin</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </rng>
Apr 14 05:42:04 user nova-compute[71312]:     <filesystem supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='driverType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>path</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>handle</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtiofs</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </filesystem>
Apr 14 05:42:04 user nova-compute[71312]:     <tpm supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-tis</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-crb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>passthrough</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>emulator</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </tpm>
Apr 14 05:42:04 user nova-compute[71312]:   </devices>
Apr 14 05:42:04 user nova-compute[71312]:   <features>
Apr 14 05:42:04 user nova-compute[71312]:     <gic supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <genid supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backup supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <sev supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:   </features>
Apr 14 05:42:04 user nova-compute[71312]: </domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 05:42:04 user nova-compute[71312]: <domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 05:42:04 user nova-compute[71312]:   <domain>kvm</domain>
Apr 14 05:42:04 user nova-compute[71312]:   <machine>pc-i440fx-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:   <arch>x86_64</arch>
Apr 14 05:42:04 user nova-compute[71312]:   <vcpu max='255'/>
Apr 14 05:42:04 user nova-compute[71312]:   <iothreads supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:   <os supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='firmware'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>efi</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:     <loader supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>rom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pflash</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='readonly'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='secure'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </loader>
Apr 14 05:42:04 user nova-compute[71312]:   </os>
Apr 14 05:42:04 user nova-compute[71312]:   <cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='maximumMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='invtsc'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='rsba'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>phenom</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>n270</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>core2duo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>athlon</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Westmere</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Penryn</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Opteron_G1</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Conroe</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>486</model>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:   </cpu>
Apr 14 05:42:04 user nova-compute[71312]:   <memoryBacking supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='sourceType'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>file</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>anonymous</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>memfd</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:   </memoryBacking>
Apr 14 05:42:04 user nova-compute[71312]:   <devices>
Apr 14 05:42:04 user nova-compute[71312]:     <disk supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='diskDevice'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>disk</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cdrom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>floppy</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>lun</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='bus'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ide</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>fdc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sata</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </disk>
Apr 14 05:42:04 user nova-compute[71312]:     <graphics supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sdl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vnc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>spice</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egl-headless</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </graphics>
Apr 14 05:42:04 user nova-compute[71312]:     <video supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='modelType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cirrus</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vmvga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>qxl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>none</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>bochs</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ramfb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </video>
Apr 14 05:42:04 user nova-compute[71312]:     <hostdev supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='mode'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>subsystem</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='startupPolicy'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>default</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>mandatory</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>requisite</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>optional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='subsysType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pci</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='capsType'/>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='pciBackend'/>
Apr 14 05:42:04 user nova-compute[71312]:     </hostdev>
Apr 14 05:42:04 user nova-compute[71312]:     <rng supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>random</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egd</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>builtin</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </rng>
Apr 14 05:42:04 user nova-compute[71312]:     <filesystem supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='driverType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>path</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>handle</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtiofs</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </filesystem>
Apr 14 05:42:04 user nova-compute[71312]:     <tpm supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-tis</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-crb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>passthrough</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>emulator</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </tpm>
Apr 14 05:42:04 user nova-compute[71312]:   </devices>
Apr 14 05:42:04 user nova-compute[71312]:   <features>
Apr 14 05:42:04 user nova-compute[71312]:     <gic supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <genid supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backup supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <sev supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:   </features>
Apr 14 05:42:04 user nova-compute[71312]: </domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 05:42:04 user nova-compute[71312]: <domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 05:42:04 user nova-compute[71312]:   <domain>kvm</domain>
Apr 14 05:42:04 user nova-compute[71312]:   <machine>pc-q35-6.2</machine>
Apr 14 05:42:04 user nova-compute[71312]:   <arch>x86_64</arch>
Apr 14 05:42:04 user nova-compute[71312]:   <vcpu max='288'/>
Apr 14 05:42:04 user nova-compute[71312]:   <iothreads supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:   <os supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='firmware'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>efi</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:     <loader supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>rom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pflash</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='readonly'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='secure'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </loader>
Apr 14 05:42:04 user nova-compute[71312]:   </os>
Apr 14 05:42:04 user nova-compute[71312]:   <cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='maximumMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='invtsc'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='rsba'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>phenom</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>n270</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>core2duo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>athlon</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Westmere</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Penryn</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Opteron_G1</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Conroe</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>486</model>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:   </cpu>
Apr 14 05:42:04 user nova-compute[71312]:   <memoryBacking supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='sourceType'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>file</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>anonymous</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>memfd</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:   </memoryBacking>
Apr 14 05:42:04 user nova-compute[71312]:   <devices>
Apr 14 05:42:04 user nova-compute[71312]:     <disk supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='diskDevice'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>disk</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cdrom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>floppy</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>lun</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='bus'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>fdc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sata</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </disk>
Apr 14 05:42:04 user nova-compute[71312]:     <graphics supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sdl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vnc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>spice</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egl-headless</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </graphics>
Apr 14 05:42:04 user nova-compute[71312]:     <video supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='modelType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cirrus</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vmvga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>qxl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>none</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>bochs</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ramfb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </video>
Apr 14 05:42:04 user nova-compute[71312]:     <hostdev supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='mode'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>subsystem</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='startupPolicy'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>default</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>mandatory</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>requisite</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>optional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='subsysType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pci</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='capsType'/>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='pciBackend'/>
Apr 14 05:42:04 user nova-compute[71312]:     </hostdev>
Apr 14 05:42:04 user nova-compute[71312]:     <rng supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>random</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egd</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>builtin</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </rng>
Apr 14 05:42:04 user nova-compute[71312]:     <filesystem supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='driverType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>path</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>handle</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtiofs</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </filesystem>
Apr 14 05:42:04 user nova-compute[71312]:     <tpm supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-tis</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-crb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>passthrough</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>emulator</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </tpm>
Apr 14 05:42:04 user nova-compute[71312]:   </devices>
Apr 14 05:42:04 user nova-compute[71312]:   <features>
Apr 14 05:42:04 user nova-compute[71312]:     <gic supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <genid supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backup supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <sev supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:   </features>
Apr 14 05:42:04 user nova-compute[71312]: </domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 05:42:04 user nova-compute[71312]: <domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 05:42:04 user nova-compute[71312]:   <domain>kvm</domain>
Apr 14 05:42:04 user nova-compute[71312]:   <machine>pc-i440fx-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:   <arch>x86_64</arch>
Apr 14 05:42:04 user nova-compute[71312]:   <vcpu max='255'/>
Apr 14 05:42:04 user nova-compute[71312]:   <iothreads supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:   <os supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='firmware'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>efi</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:     <loader supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>rom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pflash</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='readonly'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='secure'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </loader>
Apr 14 05:42:04 user nova-compute[71312]:   </os>
Apr 14 05:42:04 user nova-compute[71312]:   <cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='maximumMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='invtsc'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='rsba'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>phenom</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>n270</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>core2duo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>athlon</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Westmere</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Penryn</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Opteron_G1</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Conroe</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>486</model>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:   </cpu>
Apr 14 05:42:04 user nova-compute[71312]:   <memoryBacking supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='sourceType'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>file</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>anonymous</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>memfd</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:   </memoryBacking>
Apr 14 05:42:04 user nova-compute[71312]:   <devices>
Apr 14 05:42:04 user nova-compute[71312]:     <disk supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='diskDevice'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>disk</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cdrom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>floppy</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>lun</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='bus'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ide</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>fdc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sata</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </disk>
Apr 14 05:42:04 user nova-compute[71312]:     <graphics supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sdl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vnc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>spice</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egl-headless</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </graphics>
Apr 14 05:42:04 user nova-compute[71312]:     <video supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='modelType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cirrus</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vmvga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>qxl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>none</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>bochs</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ramfb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </video>
Apr 14 05:42:04 user nova-compute[71312]:     <hostdev supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='mode'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>subsystem</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='startupPolicy'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>default</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>mandatory</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>requisite</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>optional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='subsysType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pci</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='capsType'/>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='pciBackend'/>
Apr 14 05:42:04 user nova-compute[71312]:     </hostdev>
Apr 14 05:42:04 user nova-compute[71312]:     <rng supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>random</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egd</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>builtin</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </rng>
Apr 14 05:42:04 user nova-compute[71312]:     <filesystem supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='driverType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>path</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>handle</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtiofs</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </filesystem>
Apr 14 05:42:04 user nova-compute[71312]:     <tpm supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-tis</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-crb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>passthrough</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>emulator</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </tpm>
Apr 14 05:42:04 user nova-compute[71312]:   </devices>
Apr 14 05:42:04 user nova-compute[71312]:   <features>
Apr 14 05:42:04 user nova-compute[71312]:     <gic supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <genid supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backup supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <sev supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:   </features>
Apr 14 05:42:04 user nova-compute[71312]: </domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 05:42:04 user nova-compute[71312]: <domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 05:42:04 user nova-compute[71312]:   <domain>kvm</domain>
Apr 14 05:42:04 user nova-compute[71312]:   <machine>pc-q35-jammy</machine>
Apr 14 05:42:04 user nova-compute[71312]:   <arch>x86_64</arch>
Apr 14 05:42:04 user nova-compute[71312]:   <vcpu max='288'/>
Apr 14 05:42:04 user nova-compute[71312]:   <iothreads supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:   <os supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='firmware'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>efi</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:     <loader supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>rom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pflash</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='readonly'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='secure'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>yes</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>no</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </loader>
Apr 14 05:42:04 user nova-compute[71312]:   </os>
Apr 14 05:42:04 user nova-compute[71312]:   <cpu>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-passthrough' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='hostPassthroughMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='maximum' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='maximumMigratable'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>on</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>off</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='host-model' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <vendor>Intel</vendor>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ss'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='vmx'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pcid'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='hypervisor'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arat'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='umip'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='md-clear'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='invtsc'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibpb'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='ibrs'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-stibp'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='rsba'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='erms'/>
Apr 14 05:42:04 user nova-compute[71312]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:     <mode name='custom' supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>qemu64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>qemu32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>phenom</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>pentium</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>n270</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm64</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>kvm32</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>coreduo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>core2duo</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>athlon</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Westmere</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Snowridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Skylake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>SandyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Penryn</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G5</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G4</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G3</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Opteron_G2</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Opteron_G1</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>IvyBridge</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Icelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Haswell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Rome</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-Milan</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>EPYC</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Dhyana</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cooperlake</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>Conroe</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='no'>Broadwell</model>
Apr 14 05:42:04 user nova-compute[71312]:       <model usable='yes'>486</model>
Apr 14 05:42:04 user nova-compute[71312]:     </mode>
Apr 14 05:42:04 user nova-compute[71312]:   </cpu>
Apr 14 05:42:04 user nova-compute[71312]:   <memoryBacking supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:     <enum name='sourceType'>
Apr 14 05:42:04 user nova-compute[71312]:       <value>file</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>anonymous</value>
Apr 14 05:42:04 user nova-compute[71312]:       <value>memfd</value>
Apr 14 05:42:04 user nova-compute[71312]:     </enum>
Apr 14 05:42:04 user nova-compute[71312]:   </memoryBacking>
Apr 14 05:42:04 user nova-compute[71312]:   <devices>
Apr 14 05:42:04 user nova-compute[71312]:     <disk supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='diskDevice'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>disk</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cdrom</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>floppy</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>lun</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='bus'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>fdc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sata</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </disk>
Apr 14 05:42:04 user nova-compute[71312]:     <graphics supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='type'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>sdl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vnc</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>spice</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egl-headless</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </graphics>
Apr 14 05:42:04 user nova-compute[71312]:     <video supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='modelType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>cirrus</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>vmvga</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>qxl</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>none</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>bochs</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>ramfb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </video>
Apr 14 05:42:04 user nova-compute[71312]:     <hostdev supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='mode'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>subsystem</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='startupPolicy'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>default</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>mandatory</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>requisite</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>optional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='subsysType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>usb</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>pci</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>scsi</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='capsType'/>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='pciBackend'/>
Apr 14 05:42:04 user nova-compute[71312]:     </hostdev>
Apr 14 05:42:04 user nova-compute[71312]:     <rng supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtio-non-transitional</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>random</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>egd</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>builtin</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </rng>
Apr 14 05:42:04 user nova-compute[71312]:     <filesystem supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='driverType'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>path</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>handle</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>virtiofs</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </filesystem>
Apr 14 05:42:04 user nova-compute[71312]:     <tpm supported='yes'>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='model'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-tis</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>tpm-crb</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:       <enum name='backendModel'>
Apr 14 05:42:04 user nova-compute[71312]:         <value>passthrough</value>
Apr 14 05:42:04 user nova-compute[71312]:         <value>emulator</value>
Apr 14 05:42:04 user nova-compute[71312]:       </enum>
Apr 14 05:42:04 user nova-compute[71312]:     </tpm>
Apr 14 05:42:04 user nova-compute[71312]:   </devices>
Apr 14 05:42:04 user nova-compute[71312]:   <features>
Apr 14 05:42:04 user nova-compute[71312]:     <gic supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:     <vmcoreinfo supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <genid supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backingStoreInput supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <backup supported='yes'/>
Apr 14 05:42:04 user nova-compute[71312]:     <sev supported='no'/>
Apr 14 05:42:04 user nova-compute[71312]:   </features>
Apr 14 05:42:04 user nova-compute[71312]: </domainCapabilities>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71312) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71312) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Checking secure boot support for host arch (x86_64) {{(pid=71312) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Checking secure boot support for host arch (x86_64) {{(pid=71312) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Checking secure boot support for host arch (x86_64) {{(pid=71312) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 05:42:04 user nova-compute[71312]: INFO nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Secure Boot support detected
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] cpu compare xml: <cpu match="exact">
Apr 14 05:42:04 user nova-compute[71312]:   <model>Nehalem</model>
Apr 14 05:42:04 user nova-compute[71312]: </cpu>
Apr 14 05:42:04 user nova-compute[71312]:  {{(pid=71312) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 05:42:04 user nova-compute[71312]: INFO nova.virt.node [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Generated node identity e19fba5b-1054-4428-a84f-a1d3a8496382
Apr 14 05:42:04 user nova-compute[71312]: INFO nova.virt.node [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Wrote node identity e19fba5b-1054-4428-a84f-a1d3a8496382 to /opt/stack/data/nova/compute_id
Apr 14 05:42:04 user nova-compute[71312]: WARNING nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Compute nodes ['e19fba5b-1054-4428-a84f-a1d3a8496382'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 05:42:04 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 05:42:04 user nova-compute[71312]: WARNING nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 05:42:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:42:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:42:05 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:42:05 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Hypervisor/Node resource view: name=user free_ram=10817MB free_disk=27.058929443359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:42:05 user nova-compute[71312]: WARNING nova.compute.resource_tracker [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] No compute node record for user:e19fba5b-1054-4428-a84f-a1d3a8496382: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e19fba5b-1054-4428-a84f-a1d3a8496382 could not be found.
Apr 14 05:42:05 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Compute node record created for user:user with uuid: e19fba5b-1054-4428-a84f-a1d3a8496382
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:42:05 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [req-58f5e3fb-5534-4b06-99db-aefa64208dd8] Created resource provider record via placement API for resource provider with UUID e19fba5b-1054-4428-a84f-a1d3a8496382 and name user.
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71312) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 05:42:05 user nova-compute[71312]: INFO nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] kernel doesn't support AMD SEV
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Libvirt baseline CPU <cpu>
Apr 14 05:42:05 user nova-compute[71312]:   <arch>x86_64</arch>
Apr 14 05:42:05 user nova-compute[71312]:   <model>Nehalem</model>
Apr 14 05:42:05 user nova-compute[71312]:   <vendor>Intel</vendor>
Apr 14 05:42:05 user nova-compute[71312]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 05:42:05 user nova-compute[71312]: </cpu>
Apr 14 05:42:05 user nova-compute[71312]:  {{(pid=71312) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Updated inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Updating resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 generation from 0 to 1 during operation: update_inventory {{(pid=71312) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Updating resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 generation from 1 to 2 during operation: update_traits {{(pid=71312) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.service [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Creating RPC server for service compute {{(pid=71312) start /opt/stack/nova/nova/service.py:182}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.service [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Join ServiceGroup membership for this service compute {{(pid=71312) start /opt/stack/nova/nova/service.py:199}}
Apr 14 05:42:05 user nova-compute[71312]: DEBUG nova.servicegroup.drivers.db [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71312) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 05:42:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:42:56 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:42:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:42:57 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:42:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=10194MB free_disk=26.972824096679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:42:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:42:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:42:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:42:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:42:57 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:42:57 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:42:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:42:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:43:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:43:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:43:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=10189MB free_disk=27.02642822265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:43:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:43:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:43:58 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:43:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:43:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:43:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:43:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 05:43:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 05:43:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:43:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:44:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:44:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:44:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:44:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:44:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=10159MB free_disk=26.79709243774414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:44:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:44:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:44:58 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:44:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:44:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:44:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:45:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:45:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:45:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:45:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:45:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:45:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:45:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:45:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:45:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:45:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:45:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=9433MB free_disk=26.82571792602539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:45:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:45:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:45:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:45:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:45:59 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:45:59 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:45:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:45:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:46:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:46:14 user nova-compute[71312]: INFO nova.compute.claims [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Claim successful on node user
Apr 14 05:46:14 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:46:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:46:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:46:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Creating image(s)
Apr 14 05:46:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "/opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "/opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "/opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG nova.policy [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5ac7cb2e42e403b998381759f922e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115d9f93613748fe825f46c46e59c1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620.part --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG nova.virt.images [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 3644c9ad-79f4-4051-9ff8-56e591db88fa was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:46:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620.part /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620.part /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620.converted" returned: 0 in 0.344s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.200s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:16 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkpwgh04g/privsep.sock']
Apr 14 05:46:16 user sudo[80020]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkpwgh04g/privsep.sock
Apr 14 05:46:16 user sudo[80020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 05:46:18 user sudo[80020]: pam_unix(sudo:session): session closed for user root
Apr 14 05:46:18 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Spawned new privsep daemon via rootwrap
Apr 14 05:46:18 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 05:46:18 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 05:46:18 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 05:46:18 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80023
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Successfully created port: 7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.179s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk 1073741824" returned: 0 in 0.047s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:46:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Cannot resize image /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lazy-loading 'migration_context' on Instance uuid 91642571-ef07-4990-bdf8-068203203d59 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Ensure instance console log exists: /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:46:20 user nova-compute[71312]: INFO nova.compute.claims [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Claim successful on node user
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:46:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:46:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Creating image(s)
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG nova.policy [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e733b69143e045bcbe99d823b02aab83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93092d7530694b63aba0a085051c0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.124s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk 1073741824" returned: 0 in 0.048s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Successfully updated port: 7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquired lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.177s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Cannot resize image /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'migration_context' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Ensure instance console log exists: /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received event network-changed-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Refreshing instance network info cache due to event network-changed-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:46:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Acquiring lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Successfully created port: b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:46:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Updating instance_info_cache with network_info: [{"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Releasing lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Instance network_info: |[{"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Acquired lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Refreshing network info cache for port 7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Start _get_guest_xml network_info=[{"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:46:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-903134627',display_name='tempest-DeleteServersTestJSON-server-903134627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-903134627',id=1,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='115d9f93613748fe825f46c46e59c1d1',ramdisk_id='',reservation_id='r-nc7p4qnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1472969533',owner_user_name='tempest-DeleteServersTestJSON-1472969533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:15Z,user_data=None,user_id='c5ac7cb2e42e403b998381759f922e9f',uuid=91642571-ef07-4990-bdf8-068203203d59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Converting VIF {"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=7cb9f34b-1d26-4234-acfd-9c6252d4dcbd,network=Network(f17fe600-6a0b-44d9-a761-cfa2fd5b7515),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb9f34b-1d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lazy-loading 'pci_devices' on Instance uuid 91642571-ef07-4990-bdf8-068203203d59 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:46:23 user nova-compute[71312]:   <uuid>91642571-ef07-4990-bdf8-068203203d59</uuid>
Apr 14 05:46:23 user nova-compute[71312]:   <name>instance-00000001</name>
Apr 14 05:46:23 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:46:23 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:46:23 user nova-compute[71312]:   <metadata>
Apr 14 05:46:23 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:46:23 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:46:23 user nova-compute[71312]:       <nova:name>tempest-DeleteServersTestJSON-server-903134627</nova:name>
Apr 14 05:46:23 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:46:23</nova:creationTime>
Apr 14 05:46:23 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:46:23 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:46:23 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:46:23 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:46:23 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:46:23 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:46:23 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:46:23 user nova-compute[71312]:       <nova:owner>
Apr 14 05:46:23 user nova-compute[71312]:         <nova:user uuid="c5ac7cb2e42e403b998381759f922e9f">tempest-DeleteServersTestJSON-1472969533-project-member</nova:user>
Apr 14 05:46:23 user nova-compute[71312]:         <nova:project uuid="115d9f93613748fe825f46c46e59c1d1">tempest-DeleteServersTestJSON-1472969533</nova:project>
Apr 14 05:46:23 user nova-compute[71312]:       </nova:owner>
Apr 14 05:46:23 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:46:23 user nova-compute[71312]:       <nova:ports>
Apr 14 05:46:23 user nova-compute[71312]:         <nova:port uuid="7cb9f34b-1d26-4234-acfd-9c6252d4dcbd">
Apr 14 05:46:23 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 05:46:23 user nova-compute[71312]:         </nova:port>
Apr 14 05:46:23 user nova-compute[71312]:       </nova:ports>
Apr 14 05:46:23 user nova-compute[71312]:     </nova:instance>
Apr 14 05:46:23 user nova-compute[71312]:   </metadata>
Apr 14 05:46:23 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:46:23 user nova-compute[71312]:     <system>
Apr 14 05:46:23 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:46:23 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:46:23 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:46:23 user nova-compute[71312]:       <entry name="serial">91642571-ef07-4990-bdf8-068203203d59</entry>
Apr 14 05:46:23 user nova-compute[71312]:       <entry name="uuid">91642571-ef07-4990-bdf8-068203203d59</entry>
Apr 14 05:46:23 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:46:23 user nova-compute[71312]:     </system>
Apr 14 05:46:23 user nova-compute[71312]:   </sysinfo>
Apr 14 05:46:23 user nova-compute[71312]:   <os>
Apr 14 05:46:23 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:46:23 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:46:23 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:46:23 user nova-compute[71312]:   </os>
Apr 14 05:46:23 user nova-compute[71312]:   <features>
Apr 14 05:46:23 user nova-compute[71312]:     <acpi/>
Apr 14 05:46:23 user nova-compute[71312]:     <apic/>
Apr 14 05:46:23 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:46:23 user nova-compute[71312]:   </features>
Apr 14 05:46:23 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:46:23 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:46:23 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:46:23 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:46:23 user nova-compute[71312]:   </clock>
Apr 14 05:46:23 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:46:23 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:46:23 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:46:23 user nova-compute[71312]:   </cpu>
Apr 14 05:46:23 user nova-compute[71312]:   <devices>
Apr 14 05:46:23 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:46:23 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:46:23 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk"/>
Apr 14 05:46:23 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:46:23 user nova-compute[71312]:     </disk>
Apr 14 05:46:23 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:46:23 user nova-compute[71312]:       <mac address="fa:16:3e:45:4b:ca"/>
Apr 14 05:46:23 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:23 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:46:23 user nova-compute[71312]:       <target dev="tap7cb9f34b-1d"/>
Apr 14 05:46:23 user nova-compute[71312]:     </interface>
Apr 14 05:46:23 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:46:23 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/console.log" append="off"/>
Apr 14 05:46:23 user nova-compute[71312]:     </serial>
Apr 14 05:46:23 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:46:23 user nova-compute[71312]:     <video>
Apr 14 05:46:23 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:23 user nova-compute[71312]:     </video>
Apr 14 05:46:23 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:46:23 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:46:23 user nova-compute[71312]:     </rng>
Apr 14 05:46:23 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:46:23 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:46:23 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:46:23 user nova-compute[71312]:     </memballoon>
Apr 14 05:46:23 user nova-compute[71312]:   </devices>
Apr 14 05:46:23 user nova-compute[71312]: </domain>
Apr 14 05:46:23 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-903134627',display_name='tempest-DeleteServersTestJSON-server-903134627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-903134627',id=1,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='115d9f93613748fe825f46c46e59c1d1',ramdisk_id='',reservation_id='r-nc7p4qnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1472969533',owner_user_name='tempest-DeleteServersTestJSON-1472969533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:15Z,user_data=None,user_id='c5ac7cb2e42e403b998381759f922e9f',uuid=91642571-ef07-4990-bdf8-068203203d59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Converting VIF {"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=7cb9f34b-1d26-4234-acfd-9c6252d4dcbd,network=Network(f17fe600-6a0b-44d9-a761-cfa2fd5b7515),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb9f34b-1d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG os_vif [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=7cb9f34b-1d26-4234-acfd-9c6252d4dcbd,network=Network(f17fe600-6a0b-44d9-a761-cfa2fd5b7515),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb9f34b-1d') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Created schema index Interface.name {{(pid=71312) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Created schema index Port.name {{(pid=71312) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Created schema index Bridge.name {{(pid=71312) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [POLLOUT] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:46:23 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp8coo5_la/privsep.sock']
Apr 14 05:46:23 user sudo[80066]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp8coo5_la/privsep.sock
Apr 14 05:46:23 user sudo[80066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Successfully updated port: b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-changed-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Refreshing instance network info cache due to event network-changed-b5de51fa-6654-4f76-89df-063a4d6ad4f0. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance network_info: |[{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Refreshing network info cache for port b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Start _get_guest_xml network_info=[{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:46:24 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:24 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:46:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-586479502',display_name='tempest-ServerStableDeviceRescueTest-server-586479502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-586479502',id=2,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnWgZSvStsIdBllMYITUwmuqQ//xCF9VZ+dweCxYVF5I1+XtbvXBqpCGg+3VG6koL7nHVoTJQeDf4gOGrVLkZrfLOdLZg4fZIrvOc8FP4FDDoxD5XtGdp4wyTnOCB5exw==',key_name='tempest-keypair-1292881497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93092d7530694b63aba0a085051c0520',ramdisk_id='',reservation_id='r-t4mr1l4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1786618110',owner_user_name='tempest-ServerStableDeviceRescueTest-1786618110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e733b69143e045bcbe99d823b02aab83',uuid=4a200376-4747-49ed-96d4-3fe9ac338dcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Converting VIF {"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:aa:09,bridge_name='br-int',has_traffic_filtering=True,id=b5de51fa-6654-4f76-89df-063a4d6ad4f0,network=Network(94d980c4-edf3-4d22-8ae3-b029ad2d4516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5de51fa-66') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:46:25 user nova-compute[71312]:   <uuid>4a200376-4747-49ed-96d4-3fe9ac338dcc</uuid>
Apr 14 05:46:25 user nova-compute[71312]:   <name>instance-00000002</name>
Apr 14 05:46:25 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:46:25 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:46:25 user nova-compute[71312]:   <metadata>
Apr 14 05:46:25 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:46:25 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:46:25 user nova-compute[71312]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-586479502</nova:name>
Apr 14 05:46:25 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:46:24</nova:creationTime>
Apr 14 05:46:25 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:46:25 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:46:25 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:46:25 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:46:25 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:46:25 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:46:25 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:46:25 user nova-compute[71312]:       <nova:owner>
Apr 14 05:46:25 user nova-compute[71312]:         <nova:user uuid="e733b69143e045bcbe99d823b02aab83">tempest-ServerStableDeviceRescueTest-1786618110-project-member</nova:user>
Apr 14 05:46:25 user nova-compute[71312]:         <nova:project uuid="93092d7530694b63aba0a085051c0520">tempest-ServerStableDeviceRescueTest-1786618110</nova:project>
Apr 14 05:46:25 user nova-compute[71312]:       </nova:owner>
Apr 14 05:46:25 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:46:25 user nova-compute[71312]:       <nova:ports>
Apr 14 05:46:25 user nova-compute[71312]:         <nova:port uuid="b5de51fa-6654-4f76-89df-063a4d6ad4f0">
Apr 14 05:46:25 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:46:25 user nova-compute[71312]:         </nova:port>
Apr 14 05:46:25 user nova-compute[71312]:       </nova:ports>
Apr 14 05:46:25 user nova-compute[71312]:     </nova:instance>
Apr 14 05:46:25 user nova-compute[71312]:   </metadata>
Apr 14 05:46:25 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:46:25 user nova-compute[71312]:     <system>
Apr 14 05:46:25 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:46:25 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:46:25 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:46:25 user nova-compute[71312]:       <entry name="serial">4a200376-4747-49ed-96d4-3fe9ac338dcc</entry>
Apr 14 05:46:25 user nova-compute[71312]:       <entry name="uuid">4a200376-4747-49ed-96d4-3fe9ac338dcc</entry>
Apr 14 05:46:25 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:46:25 user nova-compute[71312]:     </system>
Apr 14 05:46:25 user nova-compute[71312]:   </sysinfo>
Apr 14 05:46:25 user nova-compute[71312]:   <os>
Apr 14 05:46:25 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:46:25 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:46:25 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:46:25 user nova-compute[71312]:   </os>
Apr 14 05:46:25 user nova-compute[71312]:   <features>
Apr 14 05:46:25 user nova-compute[71312]:     <acpi/>
Apr 14 05:46:25 user nova-compute[71312]:     <apic/>
Apr 14 05:46:25 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:46:25 user nova-compute[71312]:   </features>
Apr 14 05:46:25 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:46:25 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:46:25 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:46:25 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:46:25 user nova-compute[71312]:   </clock>
Apr 14 05:46:25 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:46:25 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:46:25 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:46:25 user nova-compute[71312]:   </cpu>
Apr 14 05:46:25 user nova-compute[71312]:   <devices>
Apr 14 05:46:25 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:46:25 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:46:25 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk"/>
Apr 14 05:46:25 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:46:25 user nova-compute[71312]:     </disk>
Apr 14 05:46:25 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:46:25 user nova-compute[71312]:       <mac address="fa:16:3e:e3:aa:09"/>
Apr 14 05:46:25 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:25 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:46:25 user nova-compute[71312]:       <target dev="tapb5de51fa-66"/>
Apr 14 05:46:25 user nova-compute[71312]:     </interface>
Apr 14 05:46:25 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:46:25 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/console.log" append="off"/>
Apr 14 05:46:25 user nova-compute[71312]:     </serial>
Apr 14 05:46:25 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:46:25 user nova-compute[71312]:     <video>
Apr 14 05:46:25 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:25 user nova-compute[71312]:     </video>
Apr 14 05:46:25 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:46:25 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:46:25 user nova-compute[71312]:     </rng>
Apr 14 05:46:25 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:46:25 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:46:25 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:46:25 user nova-compute[71312]:     </memballoon>
Apr 14 05:46:25 user nova-compute[71312]:   </devices>
Apr 14 05:46:25 user nova-compute[71312]: </domain>
Apr 14 05:46:25 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-586479502',display_name='tempest-ServerStableDeviceRescueTest-server-586479502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-586479502',id=2,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnWgZSvStsIdBllMYITUwmuqQ//xCF9VZ+dweCxYVF5I1+XtbvXBqpCGg+3VG6koL7nHVoTJQeDf4gOGrVLkZrfLOdLZg4fZIrvOc8FP4FDDoxD5XtGdp4wyTnOCB5exw==',key_name='tempest-keypair-1292881497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93092d7530694b63aba0a085051c0520',ramdisk_id='',reservation_id='r-t4mr1l4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1786618110',owner_user_name='tempest-ServerStableDeviceRescueTest-1786618110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e733b69143e045bcbe99d823b02aab83',uuid=4a200376-4747-49ed-96d4-3fe9ac338dcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Converting VIF {"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:aa:09,bridge_name='br-int',has_traffic_filtering=True,id=b5de51fa-6654-4f76-89df-063a4d6ad4f0,network=Network(94d980c4-edf3-4d22-8ae3-b029ad2d4516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5de51fa-66') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG os_vif [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:aa:09,bridge_name='br-int',has_traffic_filtering=True,id=b5de51fa-6654-4f76-89df-063a4d6ad4f0,network=Network(94d980c4-edf3-4d22-8ae3-b029ad2d4516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5de51fa-66') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:46:25 user sudo[80066]: pam_unix(sudo:session): session closed for user root
Apr 14 05:46:25 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Spawned new privsep daemon via rootwrap
Apr 14 05:46:25 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 05:46:25 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 05:46:25 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 05:46:25 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80074
Apr 14 05:46:25 user nova-compute[71312]: WARNING oslo_privsep.priv_context [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] privsep daemon already running
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cb9f34b-1d, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cb9f34b-1d, col_values=(('external_ids', {'iface-id': '7cb9f34b-1d26-4234-acfd-9c6252d4dcbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:4b:ca', 'vm-uuid': '91642571-ef07-4990-bdf8-068203203d59'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:25 user nova-compute[71312]: INFO os_vif [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=7cb9f34b-1d26-4234-acfd-9c6252d4dcbd,network=Network(f17fe600-6a0b-44d9-a761-cfa2fd5b7515),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb9f34b-1d')
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5de51fa-66, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5de51fa-66, col_values=(('external_ids', {'iface-id': 'b5de51fa-6654-4f76-89df-063a4d6ad4f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:aa:09', 'vm-uuid': '4a200376-4747-49ed-96d4-3fe9ac338dcc'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:25 user nova-compute[71312]: INFO os_vif [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:aa:09,bridge_name='br-int',has_traffic_filtering=True,id=b5de51fa-6654-4f76-89df-063a4d6ad4f0,network=Network(94d980c4-edf3-4d22-8ae3-b029ad2d4516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5de51fa-66')
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] No VIF found with MAC fa:16:3e:45:4b:ca, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No VIF found with MAC fa:16:3e:e3:aa:09, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Updated VIF entry in instance network info cache for port 7cb9f34b-1d26-4234-acfd-9c6252d4dcbd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Updating instance_info_cache with network_info: [{"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Releasing lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updated VIF entry in instance network info cache for port b5de51fa-6654-4f76-89df-063a4d6ad4f0. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:46:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received event network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Lock "91642571-ef07-4990-bdf8-068203203d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Lock "91642571-ef07-4990-bdf8-068203203d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] No waiting events found dispatching network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:28 user nova-compute[71312]: WARNING nova.compute.manager [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received unexpected event network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance with vm_state building and task_state spawning.
Apr 14 05:46:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451190.4809408, 91642571-ef07-4990-bdf8-068203203d59 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] VM Resumed (Lifecycle Event)
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 91642571-ef07-4990-bdf8-068203203d59] Instance spawned successfully.
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451190.4865518, 91642571-ef07-4990-bdf8-068203203d59 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] VM Started (Lifecycle Event)
Apr 14 05:46:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Took 15.41 seconds to spawn the instance on the hypervisor.
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance spawned successfully.
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451190.7436163, 4a200376-4747-49ed-96d4-3fe9ac338dcc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] VM Resumed (Lifecycle Event)
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451190.747464, 4a200376-4747-49ed-96d4-3fe9ac338dcc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] VM Started (Lifecycle Event)
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Took 16.37 seconds to build instance.
Apr 14 05:46:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.632s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Took 10.36 seconds to spawn the instance on the hypervisor.
Apr 14 05:46:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:30 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:46:31 user nova-compute[71312]: INFO nova.compute.manager [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Took 11.06 seconds to build instance.
Apr 14 05:46:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received event network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] Lock "91642571-ef07-4990-bdf8-068203203d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] Lock "91642571-ef07-4990-bdf8-068203203d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] No waiting events found dispatching network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:31 user nova-compute[71312]: WARNING nova.compute.manager [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received unexpected event network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance with vm_state active and task_state None.
Apr 14 05:46:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.301s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:35 user nova-compute[71312]: WARNING nova.compute.manager [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state active and task_state None.
Apr 14 05:46:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:37 user nova-compute[71312]: WARNING nova.compute.manager [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state active and task_state None.
Apr 14 05:46:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:46:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:46:43 user nova-compute[71312]: INFO nova.compute.claims [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Claim successful on node user
Apr 14 05:46:43 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:46:43 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:46:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:46:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:46:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Creating image(s)
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "/opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "/opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "/opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG nova.policy [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c0ba3adada84bb0975af922caaaa2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0538df9180154c65a4405779a49914b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.196s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.192s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk 1073741824" returned: 0 in 0.089s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.181s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:46:45 user nova-compute[71312]: INFO nova.compute.claims [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Claim successful on node user
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Cannot resize image /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'migration_context' on Instance uuid 932e9aba-ecce-4d2e-8486-eb2e3c685403 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Ensure instance console log exists: /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Successfully created port: a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.675s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.422s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:46:45 user nova-compute[71312]: INFO nova.compute.claims [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Claim successful on node user
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:46:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:46:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.policy [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00dda4002041403eade471624793359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9e42476ce14c31a05897a4a738ffd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:46:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Creating image(s)
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "/opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "/opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.614s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.200s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:46:46 user nova-compute[71312]: INFO nova.compute.claims [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Claim successful on node user
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:46:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.193s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk 1073741824" returned: 0 in 0.082s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.policy [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:46:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Creating image(s)
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Successfully updated port: a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received event network-changed-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Refreshing instance network info cache due to event network-changed-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] Acquiring lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] Acquired lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Refreshing network info cache for port a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:46:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Cannot resize image /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lazy-loading 'migration_context' on Instance uuid 1dc51328-8af2-4ddf-88e1-40cbba7a2823 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Ensure instance console log exists: /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.229s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Successfully created port: 8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk 1073741824" returned: 0 in 0.069s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.186s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.239s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.840s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:46:47 user nova-compute[71312]: INFO nova.compute.claims [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Claim successful on node user
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] Releasing lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquired lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Cannot resize image /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'migration_context' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Ensure instance console log exists: /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:46:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:46:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Creating image(s)
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "/opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "/opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.policy [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81250be3e69f4c68b8f583fe5f4284ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfd3e43c5734eb08d516280486d4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Successfully created port: b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Successfully updated port: 8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "refresh_cache-1dc51328-8af2-4ddf-88e1-40cbba7a2823" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquired lock "refresh_cache-1dc51328-8af2-4ddf-88e1-40cbba7a2823" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received event network-changed-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Refreshing instance network info cache due to event network-changed-8452cfda-611d-4d2b-9976-e4fe1f7eb92d. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] Acquiring lock "refresh_cache-1dc51328-8af2-4ddf-88e1-40cbba7a2823" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.185s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.763s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk 1073741824" returned: 0 in 0.085s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:46:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updating instance_info_cache with network_info: [{"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Releasing lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Instance network_info: |[{"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Start _get_guest_xml network_info=[{"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:46:48 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:48 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-842887210',display_name='tempest-VolumesAdminNegativeTest-server-842887210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-842887210',id=3,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHubLnlaLGM24dmTAWf3L1Fc2fGI319C8qFPlbCxf8okKWTBrEwOsXZzfNL2S1nurfN2NJCKG/bNFXdy2Gc8G9HK7xV+4Myzrst68DbfnEuIFN/ifyU3RjdUwb5AlTrrBA==',key_name='tempest-keypair-1347509802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0538df9180154c65a4405779a49914b3',ramdisk_id='',reservation_id='r-87a1x0ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-881296749',owner_user_name='tempest-VolumesAdminNegativeTest-881296749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c0ba3adada84bb0975af922caaaa2bc',uuid=932e9aba-ecce-4d2e-8486-eb2e3c685403,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converting VIF {"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=a9abbeea-538e-4cf6-96b0-71fdeec1f2c3,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9abbeea-53') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'pci_devices' on Instance uuid 932e9aba-ecce-4d2e-8486-eb2e3c685403 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.209s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:46:48 user nova-compute[71312]:   <uuid>932e9aba-ecce-4d2e-8486-eb2e3c685403</uuid>
Apr 14 05:46:48 user nova-compute[71312]:   <name>instance-00000003</name>
Apr 14 05:46:48 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:46:48 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:46:48 user nova-compute[71312]:   <metadata>
Apr 14 05:46:48 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:46:48 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:46:48 user nova-compute[71312]:       <nova:name>tempest-VolumesAdminNegativeTest-server-842887210</nova:name>
Apr 14 05:46:48 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:46:48</nova:creationTime>
Apr 14 05:46:48 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:46:48 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:46:48 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:46:48 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:46:48 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:46:48 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:46:48 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:46:48 user nova-compute[71312]:       <nova:owner>
Apr 14 05:46:48 user nova-compute[71312]:         <nova:user uuid="9c0ba3adada84bb0975af922caaaa2bc">tempest-VolumesAdminNegativeTest-881296749-project-member</nova:user>
Apr 14 05:46:48 user nova-compute[71312]:         <nova:project uuid="0538df9180154c65a4405779a49914b3">tempest-VolumesAdminNegativeTest-881296749</nova:project>
Apr 14 05:46:48 user nova-compute[71312]:       </nova:owner>
Apr 14 05:46:48 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:46:48 user nova-compute[71312]:       <nova:ports>
Apr 14 05:46:48 user nova-compute[71312]:         <nova:port uuid="a9abbeea-538e-4cf6-96b0-71fdeec1f2c3">
Apr 14 05:46:48 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 05:46:48 user nova-compute[71312]:         </nova:port>
Apr 14 05:46:48 user nova-compute[71312]:       </nova:ports>
Apr 14 05:46:48 user nova-compute[71312]:     </nova:instance>
Apr 14 05:46:48 user nova-compute[71312]:   </metadata>
Apr 14 05:46:48 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:46:48 user nova-compute[71312]:     <system>
Apr 14 05:46:48 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:46:48 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:46:48 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:46:48 user nova-compute[71312]:       <entry name="serial">932e9aba-ecce-4d2e-8486-eb2e3c685403</entry>
Apr 14 05:46:48 user nova-compute[71312]:       <entry name="uuid">932e9aba-ecce-4d2e-8486-eb2e3c685403</entry>
Apr 14 05:46:48 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:46:48 user nova-compute[71312]:     </system>
Apr 14 05:46:48 user nova-compute[71312]:   </sysinfo>
Apr 14 05:46:48 user nova-compute[71312]:   <os>
Apr 14 05:46:48 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:46:48 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:46:48 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:46:48 user nova-compute[71312]:   </os>
Apr 14 05:46:48 user nova-compute[71312]:   <features>
Apr 14 05:46:48 user nova-compute[71312]:     <acpi/>
Apr 14 05:46:48 user nova-compute[71312]:     <apic/>
Apr 14 05:46:48 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:46:48 user nova-compute[71312]:   </features>
Apr 14 05:46:48 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:46:48 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:46:48 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:46:48 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:46:48 user nova-compute[71312]:   </clock>
Apr 14 05:46:48 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:46:48 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:46:48 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:46:48 user nova-compute[71312]:   </cpu>
Apr 14 05:46:48 user nova-compute[71312]:   <devices>
Apr 14 05:46:48 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:46:48 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:46:48 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk"/>
Apr 14 05:46:48 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:46:48 user nova-compute[71312]:     </disk>
Apr 14 05:46:48 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:46:48 user nova-compute[71312]:       <mac address="fa:16:3e:26:b9:59"/>
Apr 14 05:46:48 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:48 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:46:48 user nova-compute[71312]:       <target dev="tapa9abbeea-53"/>
Apr 14 05:46:48 user nova-compute[71312]:     </interface>
Apr 14 05:46:48 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:46:48 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/console.log" append="off"/>
Apr 14 05:46:48 user nova-compute[71312]:     </serial>
Apr 14 05:46:48 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:46:48 user nova-compute[71312]:     <video>
Apr 14 05:46:48 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:48 user nova-compute[71312]:     </video>
Apr 14 05:46:48 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:46:48 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:46:48 user nova-compute[71312]:     </rng>
Apr 14 05:46:48 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:46:48 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:46:48 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:46:48 user nova-compute[71312]:     </memballoon>
Apr 14 05:46:48 user nova-compute[71312]:   </devices>
Apr 14 05:46:48 user nova-compute[71312]: </domain>
Apr 14 05:46:48 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-842887210',display_name='tempest-VolumesAdminNegativeTest-server-842887210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-842887210',id=3,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHubLnlaLGM24dmTAWf3L1Fc2fGI319C8qFPlbCxf8okKWTBrEwOsXZzfNL2S1nurfN2NJCKG/bNFXdy2Gc8G9HK7xV+4Myzrst68DbfnEuIFN/ifyU3RjdUwb5AlTrrBA==',key_name='tempest-keypair-1347509802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0538df9180154c65a4405779a49914b3',ramdisk_id='',reservation_id='r-87a1x0ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-881296749',owner_user_name='tempest-VolumesAdminNegativeTest-881296749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c0ba3adada84bb0975af922caaaa2bc',uuid=932e9aba-ecce-4d2e-8486-eb2e3c685403,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converting VIF {"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=a9abbeea-538e-4cf6-96b0-71fdeec1f2c3,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9abbeea-53') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG os_vif [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=a9abbeea-538e-4cf6-96b0-71fdeec1f2c3,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9abbeea-53') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:46:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Creating image(s)
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "/opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "/opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "1782d2f4cc60c28e3515daa896f4fe6002764060" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "1782d2f4cc60c28e3515daa896f4fe6002764060" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9abbeea-53, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9abbeea-53, col_values=(('external_ids', {'iface-id': 'a9abbeea-538e-4cf6-96b0-71fdeec1f2c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:b9:59', 'vm-uuid': '932e9aba-ecce-4d2e-8486-eb2e3c685403'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:48 user nova-compute[71312]: INFO os_vif [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=a9abbeea-538e-4cf6-96b0-71fdeec1f2c3,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9abbeea-53')
Apr 14 05:46:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Cannot resize image /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lazy-loading 'migration_context' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Updating instance_info_cache with network_info: [{"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Ensure instance console log exists: /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Releasing lock "refresh_cache-1dc51328-8af2-4ddf-88e1-40cbba7a2823" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Instance network_info: |[{"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.policy [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b3721f81d2a41dc9493325afb204147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec916486c6643bebea6707752266f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Successfully updated port: b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] Acquired lock "refresh_cache-1dc51328-8af2-4ddf-88e1-40cbba7a2823" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Refreshing network info cache for port 8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Start _get_guest_xml network_info=[{"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquired lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-changed-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Refreshing instance network info cache due to event network-changed-b5264ebc-31b1-434f-b555-abcbebb4c6e2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] Acquiring lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] No VIF found with MAC fa:16:3e:26:b9:59, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:46:49 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:49 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1106076483',display_name='tempest-VolumesActionsTest-instance-1106076483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1106076483',id=4,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e9e42476ce14c31a05897a4a738ffd4',ramdisk_id='',reservation_id='r-6yl010t6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2128027182',owner_user_name='tempest-VolumesActionsTest-2128027182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:46Z,user_data=None,user_id='00dda4002041403eade471624793359c',uuid=1dc51328-8af2-4ddf-88e1-40cbba7a2823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Converting VIF {"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=8452cfda-611d-4d2b-9976-e4fe1f7eb92d,network=Network(977dfb64-b72b-4f61-b628-2531e911dd6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8452cfda-61') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.objects.instance [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dc51328-8af2-4ddf-88e1-40cbba7a2823 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060.part --force-share --output=json" returned: 0 in 0.201s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.images [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 265edea0-b46f-44ae-909b-198c71b4c8d1 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060.part /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Successfully created port: fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:46:49 user nova-compute[71312]:   <uuid>1dc51328-8af2-4ddf-88e1-40cbba7a2823</uuid>
Apr 14 05:46:49 user nova-compute[71312]:   <name>instance-00000004</name>
Apr 14 05:46:49 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:46:49 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:46:49 user nova-compute[71312]:   <metadata>
Apr 14 05:46:49 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:46:49 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:name>tempest-VolumesActionsTest-instance-1106076483</nova:name>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:46:49</nova:creationTime>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:46:49 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:46:49 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:owner>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:user uuid="00dda4002041403eade471624793359c">tempest-VolumesActionsTest-2128027182-project-member</nova:user>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:project uuid="6e9e42476ce14c31a05897a4a738ffd4">tempest-VolumesActionsTest-2128027182</nova:project>
Apr 14 05:46:49 user nova-compute[71312]:       </nova:owner>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:ports>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:port uuid="8452cfda-611d-4d2b-9976-e4fe1f7eb92d">
Apr 14 05:46:49 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 05:46:49 user nova-compute[71312]:         </nova:port>
Apr 14 05:46:49 user nova-compute[71312]:       </nova:ports>
Apr 14 05:46:49 user nova-compute[71312]:     </nova:instance>
Apr 14 05:46:49 user nova-compute[71312]:   </metadata>
Apr 14 05:46:49 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:46:49 user nova-compute[71312]:     <system>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="serial">1dc51328-8af2-4ddf-88e1-40cbba7a2823</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="uuid">1dc51328-8af2-4ddf-88e1-40cbba7a2823</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:46:49 user nova-compute[71312]:     </system>
Apr 14 05:46:49 user nova-compute[71312]:   </sysinfo>
Apr 14 05:46:49 user nova-compute[71312]:   <os>
Apr 14 05:46:49 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:46:49 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:46:49 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:46:49 user nova-compute[71312]:   </os>
Apr 14 05:46:49 user nova-compute[71312]:   <features>
Apr 14 05:46:49 user nova-compute[71312]:     <acpi/>
Apr 14 05:46:49 user nova-compute[71312]:     <apic/>
Apr 14 05:46:49 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:46:49 user nova-compute[71312]:   </features>
Apr 14 05:46:49 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:46:49 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:46:49 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:46:49 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:46:49 user nova-compute[71312]:   </clock>
Apr 14 05:46:49 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:46:49 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:46:49 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:46:49 user nova-compute[71312]:   </cpu>
Apr 14 05:46:49 user nova-compute[71312]:   <devices>
Apr 14 05:46:49 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:46:49 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:46:49 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk"/>
Apr 14 05:46:49 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:46:49 user nova-compute[71312]:     </disk>
Apr 14 05:46:49 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:46:49 user nova-compute[71312]:       <mac address="fa:16:3e:3e:a8:ff"/>
Apr 14 05:46:49 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:49 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:46:49 user nova-compute[71312]:       <target dev="tap8452cfda-61"/>
Apr 14 05:46:49 user nova-compute[71312]:     </interface>
Apr 14 05:46:49 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:46:49 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/console.log" append="off"/>
Apr 14 05:46:49 user nova-compute[71312]:     </serial>
Apr 14 05:46:49 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:46:49 user nova-compute[71312]:     <video>
Apr 14 05:46:49 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:49 user nova-compute[71312]:     </video>
Apr 14 05:46:49 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:46:49 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:46:49 user nova-compute[71312]:     </rng>
Apr 14 05:46:49 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:46:49 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:46:49 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:46:49 user nova-compute[71312]:     </memballoon>
Apr 14 05:46:49 user nova-compute[71312]:   </devices>
Apr 14 05:46:49 user nova-compute[71312]: </domain>
Apr 14 05:46:49 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1106076483',display_name='tempest-VolumesActionsTest-instance-1106076483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1106076483',id=4,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e9e42476ce14c31a05897a4a738ffd4',ramdisk_id='',reservation_id='r-6yl010t6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2128027182',owner_user_name='tempest-VolumesActionsTest-2128027182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:46Z,user_data=None,user_id='00dda4002041403eade471624793359c',uuid=1dc51328-8af2-4ddf-88e1-40cbba7a2823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Converting VIF {"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=8452cfda-611d-4d2b-9976-e4fe1f7eb92d,network=Network(977dfb64-b72b-4f61-b628-2531e911dd6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8452cfda-61') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG os_vif [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=8452cfda-611d-4d2b-9976-e4fe1f7eb92d,network=Network(977dfb64-b72b-4f61-b628-2531e911dd6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8452cfda-61') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8452cfda-61, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8452cfda-61, col_values=(('external_ids', {'iface-id': '8452cfda-611d-4d2b-9976-e4fe1f7eb92d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:a8:ff', 'vm-uuid': '1dc51328-8af2-4ddf-88e1-40cbba7a2823'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:49 user nova-compute[71312]: INFO os_vif [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=8452cfda-611d-4d2b-9976-e4fe1f7eb92d,network=Network(977dfb64-b72b-4f61-b628-2531e911dd6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8452cfda-61')
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060.part /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060.converted" returned: 0 in 0.195s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] No VIF found with MAC fa:16:3e:3e:a8:ff, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "1782d2f4cc60c28e3515daa896f4fe6002764060" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.969s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating instance_info_cache with network_info: [{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Releasing lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Instance network_info: |[{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] Acquired lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Refreshing network info cache for port b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Start _get_guest_xml network_info=[{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:46:49 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:49 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converting VIF {"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:9d,bridge_name='br-int',has_traffic_filtering=True,id=b5264ebc-31b1-434f-b555-abcbebb4c6e2,network=Network(11f5f265-3770-4817-9813-8039670d0f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5264ebc-31') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'pci_devices' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:46:49 user nova-compute[71312]:   <uuid>b91c97cd-ba56-4cd7-845d-28e6c9f37836</uuid>
Apr 14 05:46:49 user nova-compute[71312]:   <name>instance-00000005</name>
Apr 14 05:46:49 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:46:49 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:46:49 user nova-compute[71312]:   <metadata>
Apr 14 05:46:49 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:46:49 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:name>tempest-device-tagging-server-2066307036</nova:name>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:46:49</nova:creationTime>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:46:49 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:46:49 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:owner>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:user uuid="a1d16c8d82ea4d38b34bef8f1a9e9f92">tempest-TaggedAttachmentsTest-1560780204-project-member</nova:user>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:project uuid="5f62071417bf445d8982419fb3cfb625">tempest-TaggedAttachmentsTest-1560780204</nova:project>
Apr 14 05:46:49 user nova-compute[71312]:       </nova:owner>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:46:49 user nova-compute[71312]:       <nova:ports>
Apr 14 05:46:49 user nova-compute[71312]:         <nova:port uuid="b5264ebc-31b1-434f-b555-abcbebb4c6e2">
Apr 14 05:46:49 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:46:49 user nova-compute[71312]:         </nova:port>
Apr 14 05:46:49 user nova-compute[71312]:       </nova:ports>
Apr 14 05:46:49 user nova-compute[71312]:     </nova:instance>
Apr 14 05:46:49 user nova-compute[71312]:   </metadata>
Apr 14 05:46:49 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:46:49 user nova-compute[71312]:     <system>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="serial">b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="uuid">b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:46:49 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:46:49 user nova-compute[71312]:     </system>
Apr 14 05:46:49 user nova-compute[71312]:   </sysinfo>
Apr 14 05:46:49 user nova-compute[71312]:   <os>
Apr 14 05:46:49 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:46:49 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:46:49 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:46:49 user nova-compute[71312]:   </os>
Apr 14 05:46:49 user nova-compute[71312]:   <features>
Apr 14 05:46:49 user nova-compute[71312]:     <acpi/>
Apr 14 05:46:49 user nova-compute[71312]:     <apic/>
Apr 14 05:46:49 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:46:49 user nova-compute[71312]:   </features>
Apr 14 05:46:49 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:46:49 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:46:49 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:46:49 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:46:49 user nova-compute[71312]:   </clock>
Apr 14 05:46:49 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:46:49 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:46:49 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:46:49 user nova-compute[71312]:   </cpu>
Apr 14 05:46:49 user nova-compute[71312]:   <devices>
Apr 14 05:46:49 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:46:49 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:46:49 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk"/>
Apr 14 05:46:49 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:46:49 user nova-compute[71312]:     </disk>
Apr 14 05:46:49 user nova-compute[71312]:     <disk type="file" device="cdrom">
Apr 14 05:46:49 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 05:46:49 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.config"/>
Apr 14 05:46:49 user nova-compute[71312]:       <target dev="hda" bus="ide"/>
Apr 14 05:46:49 user nova-compute[71312]:     </disk>
Apr 14 05:46:49 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:46:49 user nova-compute[71312]:       <mac address="fa:16:3e:1d:f8:9d"/>
Apr 14 05:46:49 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:49 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:46:49 user nova-compute[71312]:       <target dev="tapb5264ebc-31"/>
Apr 14 05:46:49 user nova-compute[71312]:     </interface>
Apr 14 05:46:49 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:46:49 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log" append="off"/>
Apr 14 05:46:49 user nova-compute[71312]:     </serial>
Apr 14 05:46:49 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:46:49 user nova-compute[71312]:     <video>
Apr 14 05:46:49 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:49 user nova-compute[71312]:     </video>
Apr 14 05:46:49 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:46:49 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:46:49 user nova-compute[71312]:     </rng>
Apr 14 05:46:49 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:46:49 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:46:49 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:46:49 user nova-compute[71312]:     </memballoon>
Apr 14 05:46:49 user nova-compute[71312]:   </devices>
Apr 14 05:46:49 user nova-compute[71312]: </domain>
Apr 14 05:46:49 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converting VIF {"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:9d,bridge_name='br-int',has_traffic_filtering=True,id=b5264ebc-31b1-434f-b555-abcbebb4c6e2,network=Network(11f5f265-3770-4817-9813-8039670d0f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5264ebc-31') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG os_vif [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:9d,bridge_name='br-int',has_traffic_filtering=True,id=b5264ebc-31b1-434f-b555-abcbebb4c6e2,network=Network(11f5f265-3770-4817-9813-8039670d0f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5264ebc-31') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060 --force-share --output=json" returned: 0 in 0.188s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "1782d2f4cc60c28e3515daa896f4fe6002764060" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "1782d2f4cc60c28e3515daa896f4fe6002764060" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5264ebc-31, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5264ebc-31, col_values=(('external_ids', {'iface-id': 'b5264ebc-31b1-434f-b555-abcbebb4c6e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:f8:9d', 'vm-uuid': 'b91c97cd-ba56-4cd7-845d-28e6c9f37836'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:50 user nova-compute[71312]: INFO os_vif [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:f8:9d,bridge_name='br-int',has_traffic_filtering=True,id=b5264ebc-31b1-434f-b555-abcbebb4c6e2,network=Network(11f5f265-3770-4817-9813-8039670d0f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5264ebc-31')
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060 --force-share --output=json" returned: 0 in 0.173s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060,backing_fmt=raw /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060,backing_fmt=raw /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk 1073741824" returned: 0 in 0.060s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "1782d2f4cc60c28e3515daa896f4fe6002764060" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No VIF found with MAC fa:16:3e:1d:f8:9d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:46:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Using config drive
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.network.neutron [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Updated VIF entry in instance network info cache for port 8452cfda-611d-4d2b-9976-e4fe1f7eb92d. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.network.neutron [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Updating instance_info_cache with network_info: [{"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] Releasing lock "refresh_cache-1dc51328-8af2-4ddf-88e1-40cbba7a2823" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060 --force-share --output=json" returned: 0 in 0.168s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Creating config drive at /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.config
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdzcuaf7m {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.network.neutron [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updated VIF entry in instance network info cache for port b5264ebc-31b1-434f-b555-abcbebb4c6e2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.network.neutron [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating instance_info_cache with network_info: [{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdzcuaf7m" returned: 0 in 0.066s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Cannot resize image /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.objects.instance [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lazy-loading 'migration_context' on Instance uuid 4f0881a2-86a2-40e5-8c3a-1ca12da65aae {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] Releasing lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Ensure instance console log exists: /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Successfully created port: 5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Successfully updated port: fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquired lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received event network-changed-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Refreshing instance network info cache due to event network-changed-fd4d27b7-aa72-41ed-8d91-6410737250a7. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] Acquiring lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Updating instance_info_cache with network_info: [{"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Releasing lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Instance network_info: |[{"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] Acquired lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Refreshing network info cache for port fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Start _get_guest_xml network_info=[{"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:46:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1100985565',display_name='tempest-TestVolumeSwap-server-1100985565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1100985565',id=6,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlWU7SVFm1tuCRrJXBYhvYIFp1UGrJ9o4IhyFdcD6RPSdDHPG4GW2uaPqr39Fgtg+WJUvkXExcaodD0utoyGFmJWSNDe/TcAU9fLYSQ/bG1lEvcb1BNS+WLp+by8swzYg==',key_name='tempest-keypair-2132035066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dfd3e43c5734eb08d516280486d4beb',ramdisk_id='',reservation_id='r-c0g854a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1588834662',owner_user_name='tempest-TestVolumeSwap-1588834662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81250be3e69f4c68b8f583fe5f4284ae',uuid=a7fd3290-73e1-438e-9301-4a668e50c3be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Converting VIF {"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:95:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd4d27b7-aa72-41ed-8d91-6410737250a7,network=Network(b7e63f6a-8aac-4de5-a83d-323daaf7d557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4d27b7-aa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lazy-loading 'pci_devices' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:46:52 user nova-compute[71312]:   <uuid>a7fd3290-73e1-438e-9301-4a668e50c3be</uuid>
Apr 14 05:46:52 user nova-compute[71312]:   <name>instance-00000006</name>
Apr 14 05:46:52 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:46:52 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:46:52 user nova-compute[71312]:   <metadata>
Apr 14 05:46:52 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:46:52 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:46:52 user nova-compute[71312]:       <nova:name>tempest-TestVolumeSwap-server-1100985565</nova:name>
Apr 14 05:46:52 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:46:52</nova:creationTime>
Apr 14 05:46:52 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:46:52 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:46:52 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:46:52 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:46:52 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:46:52 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:46:52 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:46:52 user nova-compute[71312]:       <nova:owner>
Apr 14 05:46:52 user nova-compute[71312]:         <nova:user uuid="81250be3e69f4c68b8f583fe5f4284ae">tempest-TestVolumeSwap-1588834662-project-member</nova:user>
Apr 14 05:46:52 user nova-compute[71312]:         <nova:project uuid="4dfd3e43c5734eb08d516280486d4beb">tempest-TestVolumeSwap-1588834662</nova:project>
Apr 14 05:46:52 user nova-compute[71312]:       </nova:owner>
Apr 14 05:46:52 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:46:52 user nova-compute[71312]:       <nova:ports>
Apr 14 05:46:52 user nova-compute[71312]:         <nova:port uuid="fd4d27b7-aa72-41ed-8d91-6410737250a7">
Apr 14 05:46:52 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 05:46:52 user nova-compute[71312]:         </nova:port>
Apr 14 05:46:52 user nova-compute[71312]:       </nova:ports>
Apr 14 05:46:52 user nova-compute[71312]:     </nova:instance>
Apr 14 05:46:52 user nova-compute[71312]:   </metadata>
Apr 14 05:46:52 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:46:52 user nova-compute[71312]:     <system>
Apr 14 05:46:52 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:46:52 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:46:52 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:46:52 user nova-compute[71312]:       <entry name="serial">a7fd3290-73e1-438e-9301-4a668e50c3be</entry>
Apr 14 05:46:52 user nova-compute[71312]:       <entry name="uuid">a7fd3290-73e1-438e-9301-4a668e50c3be</entry>
Apr 14 05:46:52 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:46:52 user nova-compute[71312]:     </system>
Apr 14 05:46:52 user nova-compute[71312]:   </sysinfo>
Apr 14 05:46:52 user nova-compute[71312]:   <os>
Apr 14 05:46:52 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:46:52 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:46:52 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:46:52 user nova-compute[71312]:   </os>
Apr 14 05:46:52 user nova-compute[71312]:   <features>
Apr 14 05:46:52 user nova-compute[71312]:     <acpi/>
Apr 14 05:46:52 user nova-compute[71312]:     <apic/>
Apr 14 05:46:52 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:46:52 user nova-compute[71312]:   </features>
Apr 14 05:46:52 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:46:52 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:46:52 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:46:52 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:46:52 user nova-compute[71312]:   </clock>
Apr 14 05:46:52 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:46:52 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:46:52 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:46:52 user nova-compute[71312]:   </cpu>
Apr 14 05:46:52 user nova-compute[71312]:   <devices>
Apr 14 05:46:52 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:46:52 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:46:52 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk"/>
Apr 14 05:46:52 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:46:52 user nova-compute[71312]:     </disk>
Apr 14 05:46:52 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:46:52 user nova-compute[71312]:       <mac address="fa:16:3e:ce:95:6c"/>
Apr 14 05:46:52 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:52 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:46:52 user nova-compute[71312]:       <target dev="tapfd4d27b7-aa"/>
Apr 14 05:46:52 user nova-compute[71312]:     </interface>
Apr 14 05:46:52 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:46:52 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/console.log" append="off"/>
Apr 14 05:46:52 user nova-compute[71312]:     </serial>
Apr 14 05:46:52 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:46:52 user nova-compute[71312]:     <video>
Apr 14 05:46:52 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:52 user nova-compute[71312]:     </video>
Apr 14 05:46:52 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:46:52 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:46:52 user nova-compute[71312]:     </rng>
Apr 14 05:46:52 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:46:52 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:46:52 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:46:52 user nova-compute[71312]:     </memballoon>
Apr 14 05:46:52 user nova-compute[71312]:   </devices>
Apr 14 05:46:52 user nova-compute[71312]: </domain>
Apr 14 05:46:52 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1100985565',display_name='tempest-TestVolumeSwap-server-1100985565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1100985565',id=6,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlWU7SVFm1tuCRrJXBYhvYIFp1UGrJ9o4IhyFdcD6RPSdDHPG4GW2uaPqr39Fgtg+WJUvkXExcaodD0utoyGFmJWSNDe/TcAU9fLYSQ/bG1lEvcb1BNS+WLp+by8swzYg==',key_name='tempest-keypair-2132035066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dfd3e43c5734eb08d516280486d4beb',ramdisk_id='',reservation_id='r-c0g854a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1588834662',owner_user_name='tempest-TestVolumeSwap-1588834662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81250be3e69f4c68b8f583fe5f4284ae',uuid=a7fd3290-73e1-438e-9301-4a668e50c3be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Converting VIF {"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:95:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd4d27b7-aa72-41ed-8d91-6410737250a7,network=Network(b7e63f6a-8aac-4de5-a83d-323daaf7d557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4d27b7-aa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG os_vif [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:95:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd4d27b7-aa72-41ed-8d91-6410737250a7,network=Network(b7e63f6a-8aac-4de5-a83d-323daaf7d557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4d27b7-aa') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd4d27b7-aa, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd4d27b7-aa, col_values=(('external_ids', {'iface-id': 'fd4d27b7-aa72-41ed-8d91-6410737250a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:95:6c', 'vm-uuid': 'a7fd3290-73e1-438e-9301-4a668e50c3be'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:52 user nova-compute[71312]: INFO os_vif [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:95:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd4d27b7-aa72-41ed-8d91-6410737250a7,network=Network(b7e63f6a-8aac-4de5-a83d-323daaf7d557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4d27b7-aa')
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] No VIF found with MAC fa:16:3e:ce:95:6c, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Successfully updated port: 5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquired lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received event network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] No waiting events found dispatching network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:52 user nova-compute[71312]: WARNING nova.compute.manager [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received unexpected event network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance with vm_state building and task_state spawning.
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Updated VIF entry in instance network info cache for port fd4d27b7-aa72-41ed-8d91-6410737250a7. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Updating instance_info_cache with network_info: [{"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] Releasing lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.neutron [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Updating instance_info_cache with network_info: [{"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Releasing lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Instance network_info: |[{"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Start _get_guest_xml network_info=[{"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:46:40Z,direct_url=<?>,disk_format='qcow2',id=265edea0-b46f-44ae-909b-198c71b4c8d1,min_disk=0,min_ram=0,name='',owner='57c286c4e3f44ff88d6c6e633ad882e1',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:46:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'size': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '265edea0-b46f-44ae-909b-198c71b4c8d1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:53 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:46:40Z,direct_url=<?>,disk_format='qcow2',id=265edea0-b46f-44ae-909b-198c71b4c8d1,min_disk=0,min_ram=0,name='',owner='57c286c4e3f44ff88d6c6e633ad882e1',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:46:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-760918348',display_name='tempest-AttachSCSIVolumeTestJSON-server-760918348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-760918348',id=7,image_ref='265edea0-b46f-44ae-909b-198c71b4c8d1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7C9zWhHZvnaWFVobD0Mnfae2MSh5KaphNMZEvkfDqUhYz9gHy8VtkwzvotmLNtawW1HnxqUmpmcDAoolytTyapEaauUuRr5cFa5KaitiSsx6sUpMZWQHwqw1maXBxIbQ==',key_name='tempest-keypair-242182190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dec916486c6643bebea6707752266f8d',ramdisk_id='',reservation_id='r-hfnm02j7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='265edea0-b46f-44ae-909b-198c71b4c8d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-568843138',owner_user_name='tempest-AttachSCSIVolumeTestJSON-568843138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3721f81d2a41dc9493325afb204147',uuid=4f0881a2-86a2-40e5-8c3a-1ca12da65aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Converting VIF {"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c8:59,bridge_name='br-int',has_traffic_filtering=True,id=5f81b5ce-2c7e-4901-953e-a39739dd26db,network=Network(a6fc7cf2-83ce-4137-8e63-a6316989706b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f81b5ce-2c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.objects.instance [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f0881a2-86a2-40e5-8c3a-1ca12da65aae {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:46:53 user nova-compute[71312]:   <uuid>4f0881a2-86a2-40e5-8c3a-1ca12da65aae</uuid>
Apr 14 05:46:53 user nova-compute[71312]:   <name>instance-00000007</name>
Apr 14 05:46:53 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:46:53 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:46:53 user nova-compute[71312]:   <metadata>
Apr 14 05:46:53 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:46:53 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:46:53 user nova-compute[71312]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-760918348</nova:name>
Apr 14 05:46:53 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:46:53</nova:creationTime>
Apr 14 05:46:53 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:46:53 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:46:53 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:46:53 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:46:53 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:46:53 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:46:53 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:46:53 user nova-compute[71312]:       <nova:owner>
Apr 14 05:46:53 user nova-compute[71312]:         <nova:user uuid="4b3721f81d2a41dc9493325afb204147">tempest-AttachSCSIVolumeTestJSON-568843138-project-member</nova:user>
Apr 14 05:46:53 user nova-compute[71312]:         <nova:project uuid="dec916486c6643bebea6707752266f8d">tempest-AttachSCSIVolumeTestJSON-568843138</nova:project>
Apr 14 05:46:53 user nova-compute[71312]:       </nova:owner>
Apr 14 05:46:53 user nova-compute[71312]:       <nova:root type="image" uuid="265edea0-b46f-44ae-909b-198c71b4c8d1"/>
Apr 14 05:46:53 user nova-compute[71312]:       <nova:ports>
Apr 14 05:46:53 user nova-compute[71312]:         <nova:port uuid="5f81b5ce-2c7e-4901-953e-a39739dd26db">
Apr 14 05:46:53 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 05:46:53 user nova-compute[71312]:         </nova:port>
Apr 14 05:46:53 user nova-compute[71312]:       </nova:ports>
Apr 14 05:46:53 user nova-compute[71312]:     </nova:instance>
Apr 14 05:46:53 user nova-compute[71312]:   </metadata>
Apr 14 05:46:53 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:46:53 user nova-compute[71312]:     <system>
Apr 14 05:46:53 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:46:53 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:46:53 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:46:53 user nova-compute[71312]:       <entry name="serial">4f0881a2-86a2-40e5-8c3a-1ca12da65aae</entry>
Apr 14 05:46:53 user nova-compute[71312]:       <entry name="uuid">4f0881a2-86a2-40e5-8c3a-1ca12da65aae</entry>
Apr 14 05:46:53 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:46:53 user nova-compute[71312]:     </system>
Apr 14 05:46:53 user nova-compute[71312]:   </sysinfo>
Apr 14 05:46:53 user nova-compute[71312]:   <os>
Apr 14 05:46:53 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:46:53 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:46:53 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:46:53 user nova-compute[71312]:   </os>
Apr 14 05:46:53 user nova-compute[71312]:   <features>
Apr 14 05:46:53 user nova-compute[71312]:     <acpi/>
Apr 14 05:46:53 user nova-compute[71312]:     <apic/>
Apr 14 05:46:53 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:46:53 user nova-compute[71312]:   </features>
Apr 14 05:46:53 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:46:53 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:46:53 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:46:53 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:46:53 user nova-compute[71312]:   </clock>
Apr 14 05:46:53 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:46:53 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:46:53 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:46:53 user nova-compute[71312]:   </cpu>
Apr 14 05:46:53 user nova-compute[71312]:   <devices>
Apr 14 05:46:53 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:46:53 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:46:53 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk"/>
Apr 14 05:46:53 user nova-compute[71312]:       <target dev="sda" bus="scsi"/>
Apr 14 05:46:53 user nova-compute[71312]:       <address type="drive" controller="0" unit="0"/>
Apr 14 05:46:53 user nova-compute[71312]:     </disk>
Apr 14 05:46:53 user nova-compute[71312]:     <disk type="file" device="cdrom">
Apr 14 05:46:53 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 05:46:53 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk.config"/>
Apr 14 05:46:53 user nova-compute[71312]:       <target dev="sdb" bus="scsi"/>
Apr 14 05:46:53 user nova-compute[71312]:       <address type="drive" controller="0" unit="1"/>
Apr 14 05:46:53 user nova-compute[71312]:     </disk>
Apr 14 05:46:53 user nova-compute[71312]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 05:46:53 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:46:53 user nova-compute[71312]:       <mac address="fa:16:3e:d2:c8:59"/>
Apr 14 05:46:53 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:53 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:46:53 user nova-compute[71312]:       <target dev="tap5f81b5ce-2c"/>
Apr 14 05:46:53 user nova-compute[71312]:     </interface>
Apr 14 05:46:53 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:46:53 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/console.log" append="off"/>
Apr 14 05:46:53 user nova-compute[71312]:     </serial>
Apr 14 05:46:53 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:46:53 user nova-compute[71312]:     <video>
Apr 14 05:46:53 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:46:53 user nova-compute[71312]:     </video>
Apr 14 05:46:53 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:46:53 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:46:53 user nova-compute[71312]:     </rng>
Apr 14 05:46:53 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:46:53 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:46:53 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:46:53 user nova-compute[71312]:     </memballoon>
Apr 14 05:46:53 user nova-compute[71312]:   </devices>
Apr 14 05:46:53 user nova-compute[71312]: </domain>
Apr 14 05:46:53 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-760918348',display_name='tempest-AttachSCSIVolumeTestJSON-server-760918348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-760918348',id=7,image_ref='265edea0-b46f-44ae-909b-198c71b4c8d1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7C9zWhHZvnaWFVobD0Mnfae2MSh5KaphNMZEvkfDqUhYz9gHy8VtkwzvotmLNtawW1HnxqUmpmcDAoolytTyapEaauUuRr5cFa5KaitiSsx6sUpMZWQHwqw1maXBxIbQ==',key_name='tempest-keypair-242182190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dec916486c6643bebea6707752266f8d',ramdisk_id='',reservation_id='r-hfnm02j7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='265edea0-b46f-44ae-909b-198c71b4c8d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-568843138',owner_user_name='tempest-AttachSCSIVolumeTestJSON-568843138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:46:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3721f81d2a41dc9493325afb204147',uuid=4f0881a2-86a2-40e5-8c3a-1ca12da65aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Converting VIF {"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c8:59,bridge_name='br-int',has_traffic_filtering=True,id=5f81b5ce-2c7e-4901-953e-a39739dd26db,network=Network(a6fc7cf2-83ce-4137-8e63-a6316989706b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f81b5ce-2c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG os_vif [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c8:59,bridge_name='br-int',has_traffic_filtering=True,id=5f81b5ce-2c7e-4901-953e-a39739dd26db,network=Network(a6fc7cf2-83ce-4137-8e63-a6316989706b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f81b5ce-2c') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f81b5ce-2c, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f81b5ce-2c, col_values=(('external_ids', {'iface-id': '5f81b5ce-2c7e-4901-953e-a39739dd26db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:c8:59', 'vm-uuid': '4f0881a2-86a2-40e5-8c3a-1ca12da65aae'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:53 user nova-compute[71312]: INFO os_vif [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c8:59,bridge_name='br-int',has_traffic_filtering=True,id=5f81b5ce-2c7e-4901-953e-a39739dd26db,network=Network(a6fc7cf2-83ce-4137-8e63-a6316989706b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f81b5ce-2c')
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] No BDM found with device name sda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] No VIF found with MAC fa:16:3e:d2:c8:59, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:46:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Using config drive
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received event network-changed-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Refreshing instance network info cache due to event network-changed-5f81b5ce-2c7e-4901-953e-a39739dd26db. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] Acquiring lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] Acquired lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Refreshing network info cache for port 5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:46:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Creating config drive at /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk.config
Apr 14 05:46:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm4o5yb2q {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm4o5yb2q" returned: 0 in 0.074s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Updated VIF entry in instance network info cache for port 5f81b5ce-2c7e-4901-953e-a39739dd26db. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Updating instance_info_cache with network_info: [{"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:46:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] Releasing lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:46:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received event network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] No waiting events found dispatching network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:54 user nova-compute[71312]: WARNING nova.compute.manager [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received unexpected event network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance with vm_state building and task_state spawning.
Apr 14 05:46:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received event network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] Acquiring lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] No waiting events found dispatching network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:55 user nova-compute[71312]: WARNING nova.compute.manager [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received unexpected event network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance with vm_state building and task_state spawning.
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received event network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] No waiting events found dispatching network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:56 user nova-compute[71312]: WARNING nova.compute.manager [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received unexpected event network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance with vm_state building and task_state spawning.
Apr 14 05:46:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] No waiting events found dispatching network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:57 user nova-compute[71312]: WARNING nova.compute.manager [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received unexpected event network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance with vm_state building and task_state spawning.
Apr 14 05:46:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received event network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] Acquiring lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] No waiting events found dispatching network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:57 user nova-compute[71312]: WARNING nova.compute.manager [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received unexpected event network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance with vm_state building and task_state spawning.
Apr 14 05:46:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received event network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] No waiting events found dispatching network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:58 user nova-compute[71312]: WARNING nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received unexpected event network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance with vm_state building and task_state spawning.
Apr 14 05:46:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received event network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] No waiting events found dispatching network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:58 user nova-compute[71312]: WARNING nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received unexpected event network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db for instance with vm_state building and task_state spawning.
Apr 14 05:46:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received event network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] No waiting events found dispatching network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:58 user nova-compute[71312]: WARNING nova.compute.manager [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received unexpected event network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db for instance with vm_state building and task_state spawning.
Apr 14 05:46:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451219.4063997, 932e9aba-ecce-4d2e-8486-eb2e3c685403 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:46:59 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] VM Resumed (Lifecycle Event)
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:46:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Instance spawned successfully.
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:46:59 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451219.4094899, 932e9aba-ecce-4d2e-8486-eb2e3c685403 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:46:59 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] VM Started (Lifecycle Event)
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:46:59 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:46:59 user nova-compute[71312]: INFO nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Took 15.22 seconds to spawn the instance on the hypervisor.
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:46:59 user nova-compute[71312]: INFO nova.compute.manager [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Took 16.08 seconds to build instance.
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.232s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:46:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] No waiting events found dispatching network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:46:59 user nova-compute[71312]: WARNING nova.compute.manager [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received unexpected event network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance with vm_state building and task_state spawning.
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451220.6968102, 1dc51328-8af2-4ddf-88e1-40cbba7a2823 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] VM Resumed (Lifecycle Event)
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Instance spawned successfully.
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:47:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451220.6970623, 1dc51328-8af2-4ddf-88e1-40cbba7a2823 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] VM Started (Lifecycle Event)
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Instance spawned successfully.
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451220.8264627, a7fd3290-73e1-438e-9301-4a668e50c3be => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] VM Resumed (Lifecycle Event)
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Took 14.89 seconds to spawn the instance on the hypervisor.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Instance spawned successfully.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Instance spawned successfully.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Took 13.32 seconds to spawn the instance on the hypervisor.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451220.8351505, a7fd3290-73e1-438e-9301-4a668e50c3be => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] VM Started (Lifecycle Event)
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Took 12.84 seconds to spawn the instance on the hypervisor.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Took 14.74 seconds to spawn the instance on the hypervisor.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Took 16.55 seconds to build instance.
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451220.9302447, 4f0881a2-86a2-40e5-8c3a-1ca12da65aae => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] VM Resumed (Lifecycle Event)
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Took 15.87 seconds to build instance.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.910s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.034s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451220.941256, 4f0881a2-86a2-40e5-8c3a-1ca12da65aae => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] VM Started (Lifecycle Event)
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Took 15.11 seconds to build instance.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Took 16.47 seconds to build instance.
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.332s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451221.2943356, b91c97cd-ba56-4cd7-845d-28e6c9f37836 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] VM Resumed (Lifecycle Event)
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.660s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451221.2972653, b91c97cd-ba56-4cd7-845d-28e6c9f37836 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:02 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] VM Started (Lifecycle Event)
Apr 14 05:47:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:04 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:47:04 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8299MB free_disk=26.663742065429688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 91642571-ef07-4990-bdf8-068203203d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance a7fd3290-73e1-438e-9301-4a668e50c3be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:47:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:47:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:47:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:47:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:47:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.992s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:47:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:47:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 05:47:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:47:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 91642571-ef07-4990-bdf8-068203203d59 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] Updating instance_info_cache with network_info: [{"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-91642571-ef07-4990-bdf8-068203203d59" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:47:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:47:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "72d95729-7692-4774-b0fe-5747f558d7d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:47:13 user nova-compute[71312]: INFO nova.compute.claims [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Claim successful on node user
Apr 14 05:47:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 05:47:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 05:47:14 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:47:14 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:47:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:47:14 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:47:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:47:14 user nova-compute[71312]: INFO nova.virt.block_device [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Booting with volume b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 at /dev/vda
Apr 14 05:47:14 user nova-compute[71312]: DEBUG os_brick.utils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:14 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmplx7v6miz/privsep.sock']
Apr 14 05:47:14 user sudo[81291]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmplx7v6miz/privsep.sock
Apr 14 05:47:14 user sudo[81291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 05:47:14 user nova-compute[71312]: DEBUG nova.policy [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:47:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully created port: 9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:16 user sudo[81291]: pam_unix(sudo:session): session closed for user root
Apr 14 05:47:16 user nova-compute[71312]: INFO oslo.privsep.daemon [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Spawned new privsep daemon via rootwrap
Apr 14 05:47:16 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 05:47:16 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 05:47:16 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 05:47:16 user nova-compute[71312]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81359
Apr 14 05:47:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2794ee-1523-44f7-bdc9-aa2efe30d6cc]: (2,) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c55cbc-afc0-4d65-b7d8-1115b6958208]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:17 user nova-compute[71312]: WARNING os_brick.initiator.connectors.nvmeof [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d961ff5-ea47-4cc8-bbaa-935a75353263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca4e2ff-1df8-469a-a1f5-d87bd2bea7d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6691c7-4b1d-4fde-9859-264cfaa92247]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:17 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:47:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f13f3a-cb61-421f-817a-66f677c01749]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG os_brick.utils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== get_connector_properties: return (2352ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating existing volume attachment record: ebfe7c9d-2783-4fc1-9b92-d35623545795 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:47:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully created port: 6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully created port: e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully created port: b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "921a3289-c406-4305-8e9b-8d218461c75c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:47:19 user nova-compute[71312]: INFO nova.compute.claims [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Claim successful on node user
Apr 14 05:47:19 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:47:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:47:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:47:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully created port: a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:47:20 user nova-compute[71312]: INFO nova.virt.block_device [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Booting with volume 878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 at /dev/vda
Apr 14 05:47:20 user nova-compute[71312]: DEBUG os_brick.utils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac088024-f8ae-40fe-bbf8-e848e99f2398]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cda807-bfce-4c58-901d-43c4c120884a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG nova.policy [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63fd25b-dd89-45ba-88ac-f6a22e5482c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21c05a6-a1ef-4c00-8afc-bea135ec8d12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:20 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:47:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b143b23f-bd96-438c-8121-e531726adb78]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG os_brick.utils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:20 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating existing volume attachment record: 40ef37bd-3ce9-422b-a79c-47d2a0049f89 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully updated port: 9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-changed-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing instance network info cache due to event network-changed-9411547c-6ef0-4706-b74c-cf4f2d3e59a9. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing network info cache for port 9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully created port: a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully created port: 8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully updated port: 517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-changed-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing instance network info cache due to event network-changed-517e0448-275c-437e-9b1b-e81c27f404b4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing network info cache for port 517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully created port: c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully updated port: 26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully created port: 369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully updated port: 6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-changed-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing instance network info cache due to event network-changed-26e5a8e2-6c30-42f8-b5a5-1c3a48515231. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing network info cache for port 26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully created port: aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully updated port: e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:25 user nova-compute[71312]: INFO nova.virt.block_device [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Booting with volume 90474409-44a2-4504-806d-b14d1201747a at /dev/vdb
Apr 14 05:47:25 user nova-compute[71312]: DEBUG os_brick.utils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a56ae4a-ca8a-477f-a3dd-93a3f98ad6e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8765a57-f0a5-4566-8f01-93685ce6bfff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[91300008-1503-4543-b51c-9ec52fe66480]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff1824-6e49-4d78-8d21-3aeb3a4f0592]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:25 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d043a5-f9f4-4232-ab28-d177e215a0bf]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG os_brick.utils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating existing volume attachment record: 469b8bd0-3e51-4d73-b1f8-c06eccebb4f2 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully updated port: a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-changed-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing instance network info cache due to event network-changed-a33e4c43-ab16-4660-b246-9da472bef9a2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing network info cache for port a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully updated port: b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-changed-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing instance network info cache due to event network-changed-6a5445f4-3781-433f-821c-d24cceffd920. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing network info cache for port 6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Successfully updated port: a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully updated port: dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:27 user nova-compute[71312]: INFO nova.virt.block_device [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Booting with volume 2e76089a-274f-42de-b122-45493f24a8f8 at /dev/vdb
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-changed-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing instance network info cache due to event network-changed-e8d96b7d-3503-458c-a3d6-614617cf0a6e. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing network info cache for port e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG os_brick.utils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb71e9f-8390-41d8-98ce-84ef7413c251]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99a3b4e-3611-4f42-8c93-e295a45b25b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dfad7c-52f7-4fb6-b4cf-fb3020ea0aae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcfc51e-cc36-4d2c-9395-279938985a78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:27 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[07585379-6f02-46fd-98f7-69543f577a46]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG os_brick.utils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating existing volume attachment record: 37278760-4384-4fa7-b241-39a4499a901b {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-changed-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing instance network info cache due to event network-changed-b28d3b9e-1e32-47c0-9117-75dd980cf186. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing network info cache for port b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully updated port: 5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-changed-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing instance network info cache due to event network-changed-dac3f3ff-eeab-49f2-a538-061dc6d4afc8. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing network info cache for port dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-changed-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing instance network info cache due to event network-changed-a161f793-130d-4fcf-8f39-163ca065ebbb. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully updated port: 8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-changed-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing instance network info cache due to event network-changed-5864d2bf-030a-4e87-a76c-49ca62310068. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing network info cache for port 5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully updated port: c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully updated port: 369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-changed-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing instance network info cache due to event network-changed-8e0efe93-278b-45a0-9ff4-bdf2f96775d0. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing network info cache for port 8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-changed-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing instance network info cache due to event network-changed-c5c6cc3c-0e1a-4108-b219-4159953b3d3e. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing network info cache for port c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [{"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance network_info: |[{"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing network info cache for port a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:31 user nova-compute[71312]: INFO nova.virt.block_device [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Booting with volume c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 at /dev/vdc
Apr 14 05:47:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Successfully updated port: aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG os_brick.utils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d875073-65f0-4abb-b05a-648fe66487b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c9ce26-2571-4614-aff8-2f6c187ec793]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2969e33-9162-474f-9cdf-2648cfd90d44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25d629d-69c3-4baf-a7dc-cfbf6806791f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:31 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1386e4-ff69-4866-a9b4-5b8517412c89]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG os_brick.utils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating existing volume attachment record: 2f52c86d-3553-41a6-b815-4b17c1eecbc3 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updated VIF entry in instance network info cache for port a161f793-130d-4fcf-8f39-163ca065ebbb. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [{"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-changed-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing instance network info cache due to event network-changed-369eac45-a5df-4204-a809-3ba92cada623. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:32 user nova-compute[71312]: INFO nova.virt.block_device [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Booting with volume f35b9638-fe96-4afc-a249-05ed5a32851d at /dev/vdc
Apr 14 05:47:32 user nova-compute[71312]: DEBUG os_brick.utils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2529be0b-859f-4f65-8e72-a682994d9704]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aa38a2-1f49-40e8-8ecc-c360e64ed2e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e903d5bb-808e-4fe6-a697-75189b29c729]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[666b7f1f-94de-484d-a494-c7221e5b896a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:47:32 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:47:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[791742e2-e204-46c4-877b-2ab0e66ce6f0]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG os_brick.utils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:32 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating existing volume attachment record: a1006bce-e3eb-4ba2-a3bc-ad711e0a590c {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:47:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [{"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance network_info: |[{"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing network info cache for port 369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updated VIF entry in instance network info cache for port 369eac45-a5df-4204-a809-3ba92cada623. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [{"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-changed-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing instance network info cache due to event network-changed-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing network info cache for port aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updated VIF entry in instance network info cache for port aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:47:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [{"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:47:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Creating image(s)
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Ensure instance console log exists: /opt/stack/data/nova/instances/72d95729-7692-4774-b0fe-5747f558d7d6/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Start _get_guest_xml network_info=[{"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'ebfe7c9d-2783-4fc1-9b92-d35623545795', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEnlgmix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72d95729-7692-4774-b0fe-5747f558d7d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4966c0d-81ad-4a8d-ba8c-8fac2291fa66', 'serial': 'b4966c0d-81ad-4a8d-ba8c-8fac2291fa66'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '469b8bd0-3e51-4d73-b1f8-c06eccebb4f2', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDdSsrwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72d95729-7692-4774-b0fe-5747f558d7d6', 'attached_at': '', 'detached_at': '', 'volume_id': '90474409-44a2-4504-806d-b14d1201747a', 'serial': '90474409-44a2-4504-806d-b14d1201747a'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': '2f52c86d-3553-41a6-b815-4b17c1eecbc3', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRxfVZnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72d95729-7692-4774-b0fe-5747f558d7d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'c84bb1fa-5bc5-450e-a928-f875d1a0e0f8', 'serial': 'c84bb1fa-5bc5-450e-a928-f875d1a0e0f8'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:47:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:47:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connector [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Factory for ISCSI on None {{(pid=71312) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEnlgmix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:36 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:36 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:36 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcb74ee-1832-4619-82f7-6b8d142d2736]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:47:36 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4275eafb-09ae-4f88-b604-b773bd504af5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66] added
Apr 14 05:47:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[73909d5d-8450-4816-81a1-cebc4b27b845]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb474cb3-972f-43e1-a024-59ea29c5f511]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEnlgmix {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEnlgmix" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed5bd5-dbef-4cc9-9d25-22713fbd72d8]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZEnlgmix'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d64343a-1294-41d8-bc41-d5b27aac9ea4]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[985aba18-c3b8-44d0-b006-1252f48673dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 05:47:36 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 05:47:36 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:36 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 05:47:36 user nova-compute[71312]: 
Apr 14 05:47:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ef7e23-e16b-4446-bcb9-0f8feb87d9ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66, portal: 172.16.0.220,3260]
Apr 14 05:47:37 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66, portal: 172.16.0.220,3260] successful.
Apr 14 05:47:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[860da1ab-339d-4f70-af84-465292ed2575]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed6e7f-da7b-400a-ad90-161a0b21edb8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:37 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86116a6-7828-4240-bc83-76556e2a873a]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:37 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:47:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Creating image(s)
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Ensure instance console log exists: /opt/stack/data/nova/instances/921a3289-c406-4305-8e9b-8d218461c75c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Start _get_guest_xml network_info=[{"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '40ef37bd-3ce9-422b-a79c-47d2a0049f89', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAVNSnfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '921a3289-c406-4305-8e9b-8d218461c75c', 'attached_at': '', 'detached_at': '', 'volume_id': '878c8790-7e7d-4f18-8a8a-4e5d604ff7f1', 'serial': '878c8790-7e7d-4f18-8a8a-4e5d604ff7f1'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '37278760-4384-4fa7-b241-39a4499a901b', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhJMLElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '921a3289-c406-4305-8e9b-8d218461c75c', 'attached_at': '', 'detached_at': '', 'volume_id': '2e76089a-274f-42de-b122-45493f24a8f8', 'serial': '2e76089a-274f-42de-b122-45493f24a8f8'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': 'a1006bce-e3eb-4ba2-a3bc-ad711e0a590c', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTYDiWQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '921a3289-c406-4305-8e9b-8d218461c75c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f35b9638-fe96-4afc-a249-05ed5a32851d', 'serial': 'f35b9638-fe96-4afc-a249-05ed5a32851d'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:47:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:47:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAVNSnfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEnlgmix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26634323630383065', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634323630383065', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:38 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5624fea-fad5-4835-9008-fa999cd63786]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:47:38 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDdSsrwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45beb9c4-930a-47c7-b9fb-afc9bbfa416f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1] added
Apr 14 05:47:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4cb1b4-1fa0-47c7-bb6a-71944ef21d53]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad3c17-e0b8-43ff-8f47-abcdadbf9c64]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iAVNSnfJ {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iAVNSnfJ" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d93346-7bec-4fde-97bc-b5d95c63ca73]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iAVNSnfJ'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a992d87a-856c-4f2a-8b2c-e2c34e7b7e36]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9b420c-8fed-454c-bea0-482bb24e83e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabb4e0f-8b56-4077-9c90-779400856f4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1, portal: 172.16.0.220,3260]
Apr 14 05:47:38 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1, portal: 172.16.0.220,3260] successful.
Apr 14 05:47:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b12f60-fac8-41e4-91fd-1d5514357df5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc5ff33-0b7a-48d9-aaae-c5eb2862d0bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:38 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:38 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7afe4-433f-486b-b942-d2353240e89a]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:38 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAVNSnfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26232643732396530', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232643732396530', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.327s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:39 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:39 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhJMLElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:39 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6325aba0-4b42-486b-a43a-27c4ff5cd48e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:47:39 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7836654-1cf7-4d88-9ce6-9644de5be746]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a] added
Apr 14 05:47:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[740c4bb7-3f10-4a49-bd86-b7b693263865]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3481b795-060d-4a5f-ad2d-81e92e79ef1d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDdSsrwl {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDdSsrwl" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d7b768-5dfb-4396-9836-2da635759c4a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jDdSsrwl'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a211b-11b3-476a-a4b4-30c62407bbbe]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e11d1d9-e826-4143-b7d1-a9b305568ab9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:39 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:39 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[551d398f-7a74-48b8-b665-61f7e73d4663]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a, portal: 172.16.0.220,3260]
Apr 14 05:47:39 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a, portal: 172.16.0.220,3260] successful.
Apr 14 05:47:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e2f93f-832b-468e-8efe-05992bd2aae2]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0bd124-e92f-4355-aa52-6da159baddc1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:39 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:39 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:39 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:39 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1370db62-fae8-45b7-a3d8-6ea29054c681]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDdSsrwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== connect_volume: return (2652ms) {'type': 'block', 'scsi_wwn': '26433613865326437', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433613865326437', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.302s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:40 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRxfVZnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:40 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[71974db7-be49-46a0-82d4-2a5f1ded01b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:47:40 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d932477c-4c2f-4d71-a82c-69453d90fc23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8] added
Apr 14 05:47:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a169290-07cd-4170-b17d-f0215c029ec6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d300d1b3-ed82-443b-8ae5-08ddda1c3f93]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhJMLElo {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhJMLElo" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[158916d8-d68f-4441-808e-37b9a1787160]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhJMLElo'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c084a2e-0618-448b-8a04-3ca2412f6497]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ce1faa-84f1-4318-b428-65eaaa15db12]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:40 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:40 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:40 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:40 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:40 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d69b08-b90e-4f8f-ad94-b21cd98e85a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8, portal: 172.16.0.220,3260]
Apr 14 05:47:41 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8, portal: 172.16.0.220,3260] successful.
Apr 14 05:47:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf44ee5b-7dc9-4502-a96b-1cd534df5f72]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b181dbd-8ae8-4d50-beb3-9f941df5d470]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:41 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:41 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:41 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:41 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:41 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:41 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf03538-188c-4f03-ae0f-590ebfa3683f]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhJMLElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== connect_volume: return (2643ms) {'type': 'block', 'scsi_wwn': '23063643463636565', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063643463636565', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.307s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:42 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf66735-cc78-46ee-ab4a-c825add795ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTYDiWQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:47:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:47:42 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380365c-78ce-43ed-afde-a4cdbd079f1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8] added
Apr 14 05:47:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[259bf105-ffd7-4784-8ae6-9200b1edfd10]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b514a164-cd68-412a-8165-152bba4324df]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRxfVZnq {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRxfVZnq" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36c4d0a-f141-44a9-b995-bde9462d4f8b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRxfVZnq'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff6d2a-25f5-45d5-9669-857258051536]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a8eff4-91bd-4942-95d6-8039f4fbd1cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b954b6-3803-4b94-8186-154b38105825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8, portal: 172.16.0.220,3260]
Apr 14 05:47:42 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8, portal: 172.16.0.220,3260] successful.
Apr 14 05:47:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d4dfb0-dbce-403f-9899-f153c75dad3d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc7553c-53c6-459f-89b4-2edb37083ace]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:47:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8857b24a-874f-4c10-9c8d-9baebfc40e6f]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRxfVZnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== connect_volume: return (2686ms) {'type': 'block', 'scsi_wwn': '26638616534616362', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638616534616362', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.353s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:43 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:47:43 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[df595d4e-90cc-4be0-9f2f-0b9d0115e87c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:47:43 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a1:b5,bridge_name='br-int',has_traffic_filtering=True,id=9411547c-6ef0-4706-b74c-cf4f2d3e59a9,network=Network(b076dc22-7038-47cc-9fc1-285afb5578cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9411547c-6e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3c:09,bridge_name='br-int',has_traffic_filtering=True,id=517e0448-275c-437e-9b1b-e81c27f404b4,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap517e0448-27') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1c:0f,bridge_name='br-int',has_traffic_filtering=True,id=26e5a8e2-6c30-42f8-b5a5-1c3a48515231,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e5a8e2-6c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5445f4-3781-433f-821c-d24cceffd920,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5445f4-37') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:5f:42,bridge_name='br-int',has_traffic_filtering=True,id=e8d96b7d-3503-458c-a3d6-614617cf0a6e,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d96b7d-35') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:59:ed,bridge_name='br-int',has_traffic_filtering=True,id=b28d3b9e-1e32-47c0-9117-75dd980cf186,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28d3b9e-1e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:09:e4,bridge_name='br-int',has_traffic_filtering=True,id=a161f793-130d-4fcf-8f39-163ca065ebbb,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa161f793-13') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lazy-loading 'pci_devices' on Instance uuid 72d95729-7692-4774-b0fe-5747f558d7d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a881a6b-eb1c-4d75-99fb-b1632795e9f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d] added
Apr 14 05:47:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:47:43 user nova-compute[71312]:   <uuid>72d95729-7692-4774-b0fe-5747f558d7d6</uuid>
Apr 14 05:47:43 user nova-compute[71312]:   <name>instance-00000008</name>
Apr 14 05:47:43 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:47:43 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:47:43 user nova-compute[71312]:   <metadata>
Apr 14 05:47:43 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:47:43 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:47:43 user nova-compute[71312]:       <nova:name>tempest-device-tagging-server-408811920</nova:name>
Apr 14 05:47:43 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:47:36</nova:creationTime>
Apr 14 05:47:43 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:47:43 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:47:43 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:47:43 user nova-compute[71312]:       <nova:owner>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:user uuid="837f8d05577c40488c01fb21472b8870">tempest-TaggedBootDevicesTest_v242-735316383-project-member</nova:user>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:project uuid="4d2a45bad5274464a0b89b9e275e515e">tempest-TaggedBootDevicesTest_v242-735316383</nova:project>
Apr 14 05:47:43 user nova-compute[71312]:       </nova:owner>
Apr 14 05:47:43 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:47:43 user nova-compute[71312]:       <nova:ports>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:port uuid="9411547c-6ef0-4706-b74c-cf4f2d3e59a9">
Apr 14 05:47:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 05:47:43 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:port uuid="517e0448-275c-437e-9b1b-e81c27f404b4">
Apr 14 05:47:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Apr 14 05:47:43 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:port uuid="26e5a8e2-6c30-42f8-b5a5-1c3a48515231">
Apr 14 05:47:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Apr 14 05:47:43 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:port uuid="6a5445f4-3781-433f-821c-d24cceffd920">
Apr 14 05:47:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Apr 14 05:47:43 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:port uuid="e8d96b7d-3503-458c-a3d6-614617cf0a6e">
Apr 14 05:47:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Apr 14 05:47:43 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:port uuid="b28d3b9e-1e32-47c0-9117-75dd980cf186">
Apr 14 05:47:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 05:47:43 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:43 user nova-compute[71312]:         <nova:port uuid="a161f793-130d-4fcf-8f39-163ca065ebbb">
Apr 14 05:47:43 user nova-compute[71312]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 05:47:43 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:43 user nova-compute[71312]:       </nova:ports>
Apr 14 05:47:43 user nova-compute[71312]:     </nova:instance>
Apr 14 05:47:43 user nova-compute[71312]:   </metadata>
Apr 14 05:47:43 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:47:43 user nova-compute[71312]:     <system>
Apr 14 05:47:43 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:47:43 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:47:43 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:47:43 user nova-compute[71312]:       <entry name="serial">72d95729-7692-4774-b0fe-5747f558d7d6</entry>
Apr 14 05:47:43 user nova-compute[71312]:       <entry name="uuid">72d95729-7692-4774-b0fe-5747f558d7d6</entry>
Apr 14 05:47:43 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:47:43 user nova-compute[71312]:     </system>
Apr 14 05:47:43 user nova-compute[71312]:   </sysinfo>
Apr 14 05:47:43 user nova-compute[71312]:   <os>
Apr 14 05:47:43 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:47:43 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:47:43 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:47:43 user nova-compute[71312]:   </os>
Apr 14 05:47:43 user nova-compute[71312]:   <features>
Apr 14 05:47:43 user nova-compute[71312]:     <acpi/>
Apr 14 05:47:43 user nova-compute[71312]:     <apic/>
Apr 14 05:47:43 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:47:43 user nova-compute[71312]:   </features>
Apr 14 05:47:43 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:47:43 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:47:43 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:47:43 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:47:43 user nova-compute[71312]:   </clock>
Apr 14 05:47:43 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:47:43 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:47:43 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:47:43 user nova-compute[71312]:   </cpu>
Apr 14 05:47:43 user nova-compute[71312]:   <devices>
Apr 14 05:47:43 user nova-compute[71312]:     <disk type="file" device="cdrom">
Apr 14 05:47:43 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 05:47:43 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/72d95729-7692-4774-b0fe-5747f558d7d6/disk.config"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="hda" bus="ide"/>
Apr 14 05:47:43 user nova-compute[71312]:     </disk>
Apr 14 05:47:43 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:47:43 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:47:43 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <serial>b4966c0d-81ad-4a8d-ba8c-8fac2291fa66</serial>
Apr 14 05:47:43 user nova-compute[71312]:     </disk>
Apr 14 05:47:43 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:47:43 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:47:43 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <serial>90474409-44a2-4504-806d-b14d1201747a</serial>
Apr 14 05:47:43 user nova-compute[71312]:     </disk>
Apr 14 05:47:43 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:47:43 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:47:43 user nova-compute[71312]:       <source dev="/dev/sdf"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="vdc" bus="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <serial>c84bb1fa-5bc5-450e-a928-f875d1a0e0f8</serial>
Apr 14 05:47:43 user nova-compute[71312]:     </disk>
Apr 14 05:47:43 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:43 user nova-compute[71312]:       <mac address="fa:16:3e:7e:a1:b5"/>
Apr 14 05:47:43 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="tap9411547c-6e"/>
Apr 14 05:47:43 user nova-compute[71312]:     </interface>
Apr 14 05:47:43 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:43 user nova-compute[71312]:       <mac address="fa:16:3e:9b:3c:09"/>
Apr 14 05:47:43 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="tap517e0448-27"/>
Apr 14 05:47:43 user nova-compute[71312]:     </interface>
Apr 14 05:47:43 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:43 user nova-compute[71312]:       <mac address="fa:16:3e:a6:1c:0f"/>
Apr 14 05:47:43 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="tap26e5a8e2-6c"/>
Apr 14 05:47:43 user nova-compute[71312]:     </interface>
Apr 14 05:47:43 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:43 user nova-compute[71312]:       <mac address="fa:16:3e:2e:52:60"/>
Apr 14 05:47:43 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="tap6a5445f4-37"/>
Apr 14 05:47:43 user nova-compute[71312]:     </interface>
Apr 14 05:47:43 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:43 user nova-compute[71312]:       <mac address="fa:16:3e:93:5f:42"/>
Apr 14 05:47:43 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="tape8d96b7d-35"/>
Apr 14 05:47:43 user nova-compute[71312]:     </interface>
Apr 14 05:47:43 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:43 user nova-compute[71312]:       <mac address="fa:16:3e:87:59:ed"/>
Apr 14 05:47:43 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="tapb28d3b9e-1e"/>
Apr 14 05:47:43 user nova-compute[71312]:     </interface>
Apr 14 05:47:43 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:43 user nova-compute[71312]:       <mac address="fa:16:3e:01:09:e4"/>
Apr 14 05:47:43 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:43 user nova-compute[71312]:       <target dev="tapa161f793-13"/>
Apr 14 05:47:43 user nova-compute[71312]:     </interface>
Apr 14 05:47:43 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:47:43 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/72d95729-7692-4774-b0fe-5747f558d7d6/console.log" append="off"/>
Apr 14 05:47:43 user nova-compute[71312]:     </serial>
Apr 14 05:47:43 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:47:43 user nova-compute[71312]:     <video>
Apr 14 05:47:43 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:43 user nova-compute[71312]:     </video>
Apr 14 05:47:43 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:47:43 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:47:43 user nova-compute[71312]:     </rng>
Apr 14 05:47:43 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:47:43 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:47:43 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:47:43 user nova-compute[71312]:     </memballoon>
Apr 14 05:47:43 user nova-compute[71312]:   </devices>
Apr 14 05:47:43 user nova-compute[71312]: </domain>
Apr 14 05:47:43 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a1:b5,bridge_name='br-int',has_traffic_filtering=True,id=9411547c-6ef0-4706-b74c-cf4f2d3e59a9,network=Network(b076dc22-7038-47cc-9fc1-285afb5578cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9411547c-6e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a1:b5,bridge_name='br-int',has_traffic_filtering=True,id=9411547c-6ef0-4706-b74c-cf4f2d3e59a9,network=Network(b076dc22-7038-47cc-9fc1-285afb5578cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9411547c-6e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9411547c-6e, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9411547c-6e, col_values=(('external_ids', {'iface-id': '9411547c-6ef0-4706-b74c-cf4f2d3e59a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a1:b5', 'vm-uuid': '72d95729-7692-4774-b0fe-5747f558d7d6'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b593908-d654-4d39-a31e-c4c252fcf1b5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: INFO os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a1:b5,bridge_name='br-int',has_traffic_filtering=True,id=9411547c-6ef0-4706-b74c-cf4f2d3e59a9,network=Network(b076dc22-7038-47cc-9fc1-285afb5578cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9411547c-6e')
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3c:09,bridge_name='br-int',has_traffic_filtering=True,id=517e0448-275c-437e-9b1b-e81c27f404b4,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap517e0448-27') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3c:09,bridge_name='br-int',has_traffic_filtering=True,id=517e0448-275c-437e-9b1b-e81c27f404b4,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap517e0448-27') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap517e0448-27, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap517e0448-27, col_values=(('external_ids', {'iface-id': '517e0448-275c-437e-9b1b-e81c27f404b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:3c:09', 'vm-uuid': '72d95729-7692-4774-b0fe-5747f558d7d6'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94646b0-1f66-47ec-b4e3-99d85518be5b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTYDiWQU {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: INFO os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3c:09,bridge_name='br-int',has_traffic_filtering=True,id=517e0448-275c-437e-9b1b-e81c27f404b4,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap517e0448-27')
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1c:0f,bridge_name='br-int',has_traffic_filtering=True,id=26e5a8e2-6c30-42f8-b5a5-1c3a48515231,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e5a8e2-6c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1c:0f,bridge_name='br-int',has_traffic_filtering=True,id=26e5a8e2-6c30-42f8-b5a5-1c3a48515231,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e5a8e2-6c') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTYDiWQU" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[56298804-7fe8-4887-b532-e4cd7bfa60e7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aTYDiWQU'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26e5a8e2-6c, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26e5a8e2-6c, col_values=(('external_ids', {'iface-id': '26e5a8e2-6c30-42f8-b5a5-1c3a48515231', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:1c:0f', 'vm-uuid': '72d95729-7692-4774-b0fe-5747f558d7d6'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[32706296-246f-481d-849c-68bb17c9304a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: INFO os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1c:0f,bridge_name='br-int',has_traffic_filtering=True,id=26e5a8e2-6c30-42f8-b5a5-1c3a48515231,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e5a8e2-6c')
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5445f4-3781-433f-821c-d24cceffd920,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5445f4-37') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5445f4-3781-433f-821c-d24cceffd920,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5445f4-37') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a5445f4-37, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a5445f4-37, col_values=(('external_ids', {'iface-id': '6a5445f4-3781-433f-821c-d24cceffd920', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:52:60', 'vm-uuid': '72d95729-7692-4774-b0fe-5747f558d7d6'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea035a1-c8d1-4361-abfa-4d4d051fbaf5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: INFO os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5445f4-3781-433f-821c-d24cceffd920,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5445f4-37')
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:5f:42,bridge_name='br-int',has_traffic_filtering=True,id=e8d96b7d-3503-458c-a3d6-614617cf0a6e,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d96b7d-35') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:5f:42,bridge_name='br-int',has_traffic_filtering=True,id=e8d96b7d-3503-458c-a3d6-614617cf0a6e,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d96b7d-35') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8d96b7d-35, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8d96b7d-35, col_values=(('external_ids', {'iface-id': 'e8d96b7d-3503-458c-a3d6-614617cf0a6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:5f:42', 'vm-uuid': '72d95729-7692-4774-b0fe-5747f558d7d6'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e05ef6e-e3c5-4a24-b857-80e42406787c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d, portal: 172.16.0.220,3260]
Apr 14 05:47:43 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d, portal: 172.16.0.220,3260] successful.
Apr 14 05:47:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: INFO os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:5f:42,bridge_name='br-int',has_traffic_filtering=True,id=e8d96b7d-3503-458c-a3d6-614617cf0a6e,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d96b7d-35')
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:59:ed,bridge_name='br-int',has_traffic_filtering=True,id=b28d3b9e-1e32-47c0-9117-75dd980cf186,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28d3b9e-1e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:59:ed,bridge_name='br-int',has_traffic_filtering=True,id=b28d3b9e-1e32-47c0-9117-75dd980cf186,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28d3b9e-1e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b1527-525d-4ec6-9857-3b1f87560f65]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb28d3b9e-1e, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb28d3b9e-1e, col_values=(('external_ids', {'iface-id': 'b28d3b9e-1e32-47c0-9117-75dd980cf186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:59:ed', 'vm-uuid': '72d95729-7692-4774-b0fe-5747f558d7d6'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[620f53ca-011d-45e3-8d46-b2e923949daf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:47:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:47:43 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:47:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[68be5f8b-f223-4ba9-b52d-970a3d8cd59f]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTYDiWQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: INFO os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:59:ed,bridge_name='br-int',has_traffic_filtering=True,id=b28d3b9e-1e32-47c0-9117-75dd980cf186,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28d3b9e-1e')
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:09:e4,bridge_name='br-int',has_traffic_filtering=True,id=a161f793-130d-4fcf-8f39-163ca065ebbb,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa161f793-13') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:09:e4,bridge_name='br-int',has_traffic_filtering=True,id=a161f793-130d-4fcf-8f39-163ca065ebbb,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa161f793-13') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa161f793-13, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa161f793-13, col_values=(('external_ids', {'iface-id': 'a161f793-130d-4fcf-8f39-163ca065ebbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:09:e4', 'vm-uuid': '72d95729-7692-4774-b0fe-5747f558d7d6'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:44 user nova-compute[71312]: INFO os_vif [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:09:e4,bridge_name='br-int',has_traffic_filtering=True,id=a161f793-130d-4fcf-8f39-163ca065ebbb,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa161f793-13')
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] No VIF found with MAC fa:16:3e:7e:a1:b5, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] No VIF found with MAC fa:16:3e:93:5f:42, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:47:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Using config drive
Apr 14 05:47:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Creating config drive at /opt/stack/data/nova/instances/72d95729-7692-4774-b0fe-5747f558d7d6/disk.config
Apr 14 05:47:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/72d95729-7692-4774-b0fe-5747f558d7d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb37_f201 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/72d95729-7692-4774-b0fe-5747f558d7d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb37_f201" returned: 0 in 0.059s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== connect_volume: return (2761ms) {'type': 'block', 'scsi_wwn': '26365383962313434', 'path': '/dev/sdg'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365383962313434', 'path': '/dev/sdg'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:8c:4b,bridge_name='br-int',has_traffic_filtering=True,id=a33e4c43-ab16-4660-b246-9da472bef9a2,network=Network(d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33e4c43-ab') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:49,bridge_name='br-int',has_traffic_filtering=True,id=dac3f3ff-eeab-49f2-a538-061dc6d4afc8,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdac3f3ff-ee') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f7:e1,bridge_name='br-int',has_traffic_filtering=True,id=5864d2bf-030a-4e87-a76c-49ca62310068,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5864d2bf-03') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7d:42,bridge_name='br-int',has_traffic_filtering=True,id=8e0efe93-278b-45a0-9ff4-bdf2f96775d0,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0efe93-27') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:37:c4,bridge_name='br-int',has_traffic_filtering=True,id=c5c6cc3c-0e1a-4108-b219-4159953b3d3e,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6cc3c-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:0b,bridge_name='br-int',has_traffic_filtering=True,id=369eac45-a5df-4204-a809-3ba92cada623,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369eac45-a5') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa77d8a-ca') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:44 user nova-compute[71312]: DEBUG nova.objects.instance [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lazy-loading 'pci_devices' on Instance uuid 921a3289-c406-4305-8e9b-8d218461c75c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:47:45 user nova-compute[71312]:   <uuid>921a3289-c406-4305-8e9b-8d218461c75c</uuid>
Apr 14 05:47:45 user nova-compute[71312]:   <name>instance-00000009</name>
Apr 14 05:47:45 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:47:45 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:47:45 user nova-compute[71312]:   <metadata>
Apr 14 05:47:45 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:47:45 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:47:45 user nova-compute[71312]:       <nova:name>tempest-device-tagging-server-817313929</nova:name>
Apr 14 05:47:45 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:47:38</nova:creationTime>
Apr 14 05:47:45 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:47:45 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:47:45 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:47:45 user nova-compute[71312]:       <nova:owner>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:user uuid="7c09793a3c314acc93ba7c04d67117d0">tempest-TaggedBootDevicesTest-507690907-project-member</nova:user>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:project uuid="3ea91450b53a4089beb572b96e80a902">tempest-TaggedBootDevicesTest-507690907</nova:project>
Apr 14 05:47:45 user nova-compute[71312]:       </nova:owner>
Apr 14 05:47:45 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:47:45 user nova-compute[71312]:       <nova:ports>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:port uuid="a33e4c43-ab16-4660-b246-9da472bef9a2">
Apr 14 05:47:45 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 05:47:45 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:port uuid="dac3f3ff-eeab-49f2-a538-061dc6d4afc8">
Apr 14 05:47:45 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Apr 14 05:47:45 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:port uuid="5864d2bf-030a-4e87-a76c-49ca62310068">
Apr 14 05:47:45 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.236" ipVersion="4"/>
Apr 14 05:47:45 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:port uuid="8e0efe93-278b-45a0-9ff4-bdf2f96775d0">
Apr 14 05:47:45 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Apr 14 05:47:45 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:port uuid="c5c6cc3c-0e1a-4108-b219-4159953b3d3e">
Apr 14 05:47:45 user nova-compute[71312]:           <nova:ip type="fixed" address="10.1.1.223" ipVersion="4"/>
Apr 14 05:47:45 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:port uuid="369eac45-a5df-4204-a809-3ba92cada623">
Apr 14 05:47:45 user nova-compute[71312]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 05:47:45 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:45 user nova-compute[71312]:         <nova:port uuid="aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64">
Apr 14 05:47:45 user nova-compute[71312]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 05:47:45 user nova-compute[71312]:         </nova:port>
Apr 14 05:47:45 user nova-compute[71312]:       </nova:ports>
Apr 14 05:47:45 user nova-compute[71312]:     </nova:instance>
Apr 14 05:47:45 user nova-compute[71312]:   </metadata>
Apr 14 05:47:45 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:47:45 user nova-compute[71312]:     <system>
Apr 14 05:47:45 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:47:45 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:47:45 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:47:45 user nova-compute[71312]:       <entry name="serial">921a3289-c406-4305-8e9b-8d218461c75c</entry>
Apr 14 05:47:45 user nova-compute[71312]:       <entry name="uuid">921a3289-c406-4305-8e9b-8d218461c75c</entry>
Apr 14 05:47:45 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:47:45 user nova-compute[71312]:     </system>
Apr 14 05:47:45 user nova-compute[71312]:   </sysinfo>
Apr 14 05:47:45 user nova-compute[71312]:   <os>
Apr 14 05:47:45 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:47:45 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:47:45 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:47:45 user nova-compute[71312]:   </os>
Apr 14 05:47:45 user nova-compute[71312]:   <features>
Apr 14 05:47:45 user nova-compute[71312]:     <acpi/>
Apr 14 05:47:45 user nova-compute[71312]:     <apic/>
Apr 14 05:47:45 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:47:45 user nova-compute[71312]:   </features>
Apr 14 05:47:45 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:47:45 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:47:45 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:47:45 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:47:45 user nova-compute[71312]:   </clock>
Apr 14 05:47:45 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:47:45 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:47:45 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:47:45 user nova-compute[71312]:   </cpu>
Apr 14 05:47:45 user nova-compute[71312]:   <devices>
Apr 14 05:47:45 user nova-compute[71312]:     <disk type="file" device="cdrom">
Apr 14 05:47:45 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 05:47:45 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/921a3289-c406-4305-8e9b-8d218461c75c/disk.config"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="hda" bus="ide"/>
Apr 14 05:47:45 user nova-compute[71312]:     </disk>
Apr 14 05:47:45 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:47:45 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:47:45 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <serial>878c8790-7e7d-4f18-8a8a-4e5d604ff7f1</serial>
Apr 14 05:47:45 user nova-compute[71312]:     </disk>
Apr 14 05:47:45 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:47:45 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:47:45 user nova-compute[71312]:       <source dev="/dev/sde"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <serial>2e76089a-274f-42de-b122-45493f24a8f8</serial>
Apr 14 05:47:45 user nova-compute[71312]:     </disk>
Apr 14 05:47:45 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:47:45 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:47:45 user nova-compute[71312]:       <source dev="/dev/sdg"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="vdc" bus="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <serial>f35b9638-fe96-4afc-a249-05ed5a32851d</serial>
Apr 14 05:47:45 user nova-compute[71312]:     </disk>
Apr 14 05:47:45 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:45 user nova-compute[71312]:       <mac address="fa:16:3e:35:8c:4b"/>
Apr 14 05:47:45 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="tapa33e4c43-ab"/>
Apr 14 05:47:45 user nova-compute[71312]:     </interface>
Apr 14 05:47:45 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:45 user nova-compute[71312]:       <mac address="fa:16:3e:18:30:49"/>
Apr 14 05:47:45 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="tapdac3f3ff-ee"/>
Apr 14 05:47:45 user nova-compute[71312]:     </interface>
Apr 14 05:47:45 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:45 user nova-compute[71312]:       <mac address="fa:16:3e:d3:f7:e1"/>
Apr 14 05:47:45 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="tap5864d2bf-03"/>
Apr 14 05:47:45 user nova-compute[71312]:     </interface>
Apr 14 05:47:45 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:45 user nova-compute[71312]:       <mac address="fa:16:3e:78:7d:42"/>
Apr 14 05:47:45 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="tap8e0efe93-27"/>
Apr 14 05:47:45 user nova-compute[71312]:     </interface>
Apr 14 05:47:45 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:45 user nova-compute[71312]:       <mac address="fa:16:3e:c7:37:c4"/>
Apr 14 05:47:45 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="tapc5c6cc3c-0e"/>
Apr 14 05:47:45 user nova-compute[71312]:     </interface>
Apr 14 05:47:45 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:45 user nova-compute[71312]:       <mac address="fa:16:3e:1f:ca:0b"/>
Apr 14 05:47:45 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="tap369eac45-a5"/>
Apr 14 05:47:45 user nova-compute[71312]:     </interface>
Apr 14 05:47:45 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:47:45 user nova-compute[71312]:       <mac address="fa:16:3e:22:56:dd"/>
Apr 14 05:47:45 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:47:45 user nova-compute[71312]:       <target dev="tapaaa77d8a-ca"/>
Apr 14 05:47:45 user nova-compute[71312]:     </interface>
Apr 14 05:47:45 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:47:45 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/921a3289-c406-4305-8e9b-8d218461c75c/console.log" append="off"/>
Apr 14 05:47:45 user nova-compute[71312]:     </serial>
Apr 14 05:47:45 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:47:45 user nova-compute[71312]:     <video>
Apr 14 05:47:45 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:47:45 user nova-compute[71312]:     </video>
Apr 14 05:47:45 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:47:45 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:47:45 user nova-compute[71312]:     </rng>
Apr 14 05:47:45 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:47:45 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:47:45 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:47:45 user nova-compute[71312]:     </memballoon>
Apr 14 05:47:45 user nova-compute[71312]:   </devices>
Apr 14 05:47:45 user nova-compute[71312]: </domain>
Apr 14 05:47:45 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:8c:4b,bridge_name='br-int',has_traffic_filtering=True,id=a33e4c43-ab16-4660-b246-9da472bef9a2,network=Network(d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33e4c43-ab') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:8c:4b,bridge_name='br-int',has_traffic_filtering=True,id=a33e4c43-ab16-4660-b246-9da472bef9a2,network=Network(d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33e4c43-ab') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa33e4c43-ab, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa33e4c43-ab, col_values=(('external_ids', {'iface-id': 'a33e4c43-ab16-4660-b246-9da472bef9a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:8c:4b', 'vm-uuid': '921a3289-c406-4305-8e9b-8d218461c75c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: INFO os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:8c:4b,bridge_name='br-int',has_traffic_filtering=True,id=a33e4c43-ab16-4660-b246-9da472bef9a2,network=Network(d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33e4c43-ab')
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:49,bridge_name='br-int',has_traffic_filtering=True,id=dac3f3ff-eeab-49f2-a538-061dc6d4afc8,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdac3f3ff-ee') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:49,bridge_name='br-int',has_traffic_filtering=True,id=dac3f3ff-eeab-49f2-a538-061dc6d4afc8,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdac3f3ff-ee') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdac3f3ff-ee, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdac3f3ff-ee, col_values=(('external_ids', {'iface-id': 'dac3f3ff-eeab-49f2-a538-061dc6d4afc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:30:49', 'vm-uuid': '921a3289-c406-4305-8e9b-8d218461c75c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: INFO os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:49,bridge_name='br-int',has_traffic_filtering=True,id=dac3f3ff-eeab-49f2-a538-061dc6d4afc8,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdac3f3ff-ee')
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f7:e1,bridge_name='br-int',has_traffic_filtering=True,id=5864d2bf-030a-4e87-a76c-49ca62310068,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5864d2bf-03') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f7:e1,bridge_name='br-int',has_traffic_filtering=True,id=5864d2bf-030a-4e87-a76c-49ca62310068,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5864d2bf-03') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5864d2bf-03, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5864d2bf-03, col_values=(('external_ids', {'iface-id': '5864d2bf-030a-4e87-a76c-49ca62310068', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:f7:e1', 'vm-uuid': '921a3289-c406-4305-8e9b-8d218461c75c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: INFO os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f7:e1,bridge_name='br-int',has_traffic_filtering=True,id=5864d2bf-030a-4e87-a76c-49ca62310068,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5864d2bf-03')
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7d:42,bridge_name='br-int',has_traffic_filtering=True,id=8e0efe93-278b-45a0-9ff4-bdf2f96775d0,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0efe93-27') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7d:42,bridge_name='br-int',has_traffic_filtering=True,id=8e0efe93-278b-45a0-9ff4-bdf2f96775d0,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0efe93-27') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e0efe93-27, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e0efe93-27, col_values=(('external_ids', {'iface-id': '8e0efe93-278b-45a0-9ff4-bdf2f96775d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:7d:42', 'vm-uuid': '921a3289-c406-4305-8e9b-8d218461c75c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: INFO os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7d:42,bridge_name='br-int',has_traffic_filtering=True,id=8e0efe93-278b-45a0-9ff4-bdf2f96775d0,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0efe93-27')
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:37:c4,bridge_name='br-int',has_traffic_filtering=True,id=c5c6cc3c-0e1a-4108-b219-4159953b3d3e,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6cc3c-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:37:c4,bridge_name='br-int',has_traffic_filtering=True,id=c5c6cc3c-0e1a-4108-b219-4159953b3d3e,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6cc3c-0e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5c6cc3c-0e, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5c6cc3c-0e, col_values=(('external_ids', {'iface-id': 'c5c6cc3c-0e1a-4108-b219-4159953b3d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:37:c4', 'vm-uuid': '921a3289-c406-4305-8e9b-8d218461c75c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: INFO os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:37:c4,bridge_name='br-int',has_traffic_filtering=True,id=c5c6cc3c-0e1a-4108-b219-4159953b3d3e,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6cc3c-0e')
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:0b,bridge_name='br-int',has_traffic_filtering=True,id=369eac45-a5df-4204-a809-3ba92cada623,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369eac45-a5') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:0b,bridge_name='br-int',has_traffic_filtering=True,id=369eac45-a5df-4204-a809-3ba92cada623,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369eac45-a5') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap369eac45-a5, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap369eac45-a5, col_values=(('external_ids', {'iface-id': '369eac45-a5df-4204-a809-3ba92cada623', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:ca:0b', 'vm-uuid': '921a3289-c406-4305-8e9b-8d218461c75c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: INFO os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:0b,bridge_name='br-int',has_traffic_filtering=True,id=369eac45-a5df-4204-a809-3ba92cada623,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369eac45-a5')
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa77d8a-ca') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa77d8a-ca') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaa77d8a-ca, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaaa77d8a-ca, col_values=(('external_ids', {'iface-id': 'aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:56:dd', 'vm-uuid': '921a3289-c406-4305-8e9b-8d218461c75c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: INFO os_vif [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa77d8a-ca')
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] No VIF found with MAC fa:16:3e:35:8c:4b, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] No VIF found with MAC fa:16:3e:c7:37:c4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:47:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Using config drive
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Creating config drive at /opt/stack/data/nova/instances/921a3289-c406-4305-8e9b-8d218461c75c/disk.config
Apr 14 05:47:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/921a3289-c406-4305-8e9b-8d218461c75c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp31dadvef {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:46 user nova-compute[71312]: WARNING nova.compute.manager [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance with vm_state building and task_state spawning.
Apr 14 05:47:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/921a3289-c406-4305-8e9b-8d218461c75c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp31dadvef" returned: 0 in 0.085s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:47 user nova-compute[71312]: WARNING nova.compute.manager [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 for instance with vm_state building and task_state spawning.
Apr 14 05:47:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:48 user nova-compute[71312]: WARNING nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance with vm_state building and task_state spawning.
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:48 user nova-compute[71312]: WARNING nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 for instance with vm_state building and task_state spawning.
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:48 user nova-compute[71312]: WARNING nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 for instance with vm_state building and task_state spawning.
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:48 user nova-compute[71312]: WARNING nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance with vm_state building and task_state spawning.
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:48 user nova-compute[71312]: WARNING nova.compute.manager [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance with vm_state building and task_state spawning.
Apr 14 05:47:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:49 user nova-compute[71312]: WARNING nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 for instance with vm_state building and task_state spawning.
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:49 user nova-compute[71312]: WARNING nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance with vm_state building and task_state spawning.
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:49 user nova-compute[71312]: WARNING nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance with vm_state building and task_state spawning.
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:49 user nova-compute[71312]: WARNING nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance with vm_state building and task_state spawning.
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:49 user nova-compute[71312]: WARNING nova.compute.manager [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance with vm_state building and task_state spawning.
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:50 user nova-compute[71312]: WARNING nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb for instance with vm_state building and task_state spawning.
Apr 14 05:47:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:50 user nova-compute[71312]: WARNING nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb for instance with vm_state building and task_state spawning.
Apr 14 05:47:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:50 user nova-compute[71312]: WARNING nova.compute.manager [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance with vm_state building and task_state spawning.
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:51 user nova-compute[71312]: WARNING nova.compute.manager [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance with vm_state building and task_state spawning.
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:51 user nova-compute[71312]: WARNING nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 for instance with vm_state building and task_state spawning.
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:51 user nova-compute[71312]: WARNING nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 for instance with vm_state building and task_state spawning.
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:51 user nova-compute[71312]: WARNING nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 for instance with vm_state building and task_state spawning.
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:51 user nova-compute[71312]: WARNING nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 for instance with vm_state building and task_state spawning.
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:51 user nova-compute[71312]: WARNING nova.compute.manager [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance with vm_state building and task_state spawning.
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:52 user nova-compute[71312]: WARNING nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance with vm_state building and task_state spawning.
Apr 14 05:47:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:52 user nova-compute[71312]: WARNING nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance with vm_state building and task_state spawning.
Apr 14 05:47:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:52 user nova-compute[71312]: WARNING nova.compute.manager [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance with vm_state building and task_state spawning.
Apr 14 05:47:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451273.2801685, 72d95729-7692-4774-b0fe-5747f558d7d6 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:53 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] VM Resumed (Lifecycle Event)
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:47:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance spawned successfully.
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:53 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451273.2883453, 72d95729-7692-4774-b0fe-5747f558d7d6 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:53 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] VM Started (Lifecycle Event)
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:53 user nova-compute[71312]: WARNING nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance with vm_state building and task_state spawning.
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:53 user nova-compute[71312]: WARNING nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 for instance with vm_state building and task_state spawning.
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:53 user nova-compute[71312]: WARNING nova.compute.manager [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 for instance with vm_state building and task_state spawning.
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:53 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:53 user nova-compute[71312]: INFO nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Took 16.79 seconds to spawn the instance on the hypervisor.
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:53 user nova-compute[71312]: INFO nova.compute.manager [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Took 39.96 seconds to build instance.
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "72d95729-7692-4774-b0fe-5747f558d7d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.078s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:47:53 user nova-compute[71312]: WARNING nova.compute.manager [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance with vm_state building and task_state spawning.
Apr 14 05:47:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451274.7627378, 921a3289-c406-4305-8e9b-8d218461c75c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:54 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] VM Resumed (Lifecycle Event)
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:47:54 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance spawned successfully.
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:47:54 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451274.7658892, 921a3289-c406-4305-8e9b-8d218461c75c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:47:54 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] VM Started (Lifecycle Event)
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:47:54 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:47:54 user nova-compute[71312]: INFO nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Took 16.84 seconds to spawn the instance on the hypervisor.
Apr 14 05:47:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:47:55 user nova-compute[71312]: INFO nova.compute.manager [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Took 35.65 seconds to build instance.
Apr 14 05:47:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "921a3289-c406-4305-8e9b-8d218461c75c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.773s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "5e607038-6c40-417e-8c4f-f73f691e8672" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "5e607038-6c40-417e-8c4f-f73f691e8672" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:47:55 user nova-compute[71312]: INFO nova.compute.claims [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Claim successful on node user
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:47:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:47:55 user nova-compute[71312]: INFO nova.virt.block_device [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Booting with volume snapshot 0cf97719-b5e5-4a6e-8f63-5d1e3c365e7e at /dev/vda
Apr 14 05:47:55 user nova-compute[71312]: DEBUG nova.policy [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:47:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Successfully created port: 0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Successfully updated port: 0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "refresh_cache-5e607038-6c40-417e-8c4f-f73f691e8672" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquired lock "refresh_cache-5e607038-6c40-417e-8c4f-f73f691e8672" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received event network-changed-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Refreshing instance network info cache due to event network-changed-0d477ae1-6e7f-4888-8f7d-8d53a41f225c. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] Acquiring lock "refresh_cache-5e607038-6c40-417e-8c4f-f73f691e8672" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Updating instance_info_cache with network_info: [{"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Releasing lock "refresh_cache-5e607038-6c40-417e-8c4f-f73f691e8672" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Instance network_info: |[{"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] Acquired lock "refresh_cache-5e607038-6c40-417e-8c4f-f73f691e8672" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:47:57 user nova-compute[71312]: DEBUG nova.network.neutron [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Refreshing network info cache for port 0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:47:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:47:58 user nova-compute[71312]: DEBUG nova.network.neutron [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Updated VIF entry in instance network info cache for port 0d477ae1-6e7f-4888-8f7d-8d53a41f225c. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:47:58 user nova-compute[71312]: DEBUG nova.network.neutron [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Updating instance_info_cache with network_info: [{"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:47:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] Releasing lock "refresh_cache-5e607038-6c40-417e-8c4f-f73f691e8672" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:47:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:47:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:48:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG os_brick.utils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7716c7-ec24-4029-9e60-d0418194d662]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8c974c-a5bd-44cd-9a93-bfbbe472eba7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45d1075-d3b4-4961-8a3f-3fdf7d6d4167]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c32d109-20fc-4d47-b98d-803d4af52d85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:02 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc88311-c593-4659-916b-9d8425849413]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG os_brick.utils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Updating existing volume attachment record: 042f1010-dc5b-4390-8ac6-daad52b99a55 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:48:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=26.53057861328125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 91642571-ef07-4990-bdf8-068203203d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance a7fd3290-73e1-438e-9301-4a668e50c3be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 72d95729-7692-4774-b0fe-5747f558d7d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 921a3289-c406-4305-8e9b-8d218461c75c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5e607038-6c40-417e-8c4f-f73f691e8672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:48:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:48:04 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:48:04 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:48:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:48:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lazy-loading 'flavor' on Instance uuid 91642571-ef07-4990-bdf8-068203203d59 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:48:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:07 user nova-compute[71312]: INFO nova.compute.manager [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Attaching volume 499d646d-6940-4a45-a551-4df4745e44f3 to /dev/vdb
Apr 14 05:48:07 user nova-compute[71312]: DEBUG os_brick.utils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fed25b-8a51-4f1b-b809-3604a4168530]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de97869-d87f-4548-8430-860082188b8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e91a1-fda4-407c-9da7-078be7abbdb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9d80b9-20ed-4fca-998b-4e072d6ce115]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:07 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:48:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae75ef5-3ed7-4146-9d90-5f647dacda30]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG os_brick.utils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:07 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Updating existing volume attachment record: 4e6a1203-ea92-4762-8dad-eb05db1dd72c {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:48:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Creating image(s)
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Ensure instance console log exists: /opt/stack/data/nova/instances/5e607038-6c40-417e-8c4f-f73f691e8672/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Start _get_guest_xml network_info=[{"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '042f1010-dc5b-4390-8ac6-daad52b99a55', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBlvVJQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e607038-6c40-417e-8c4f-f73f691e8672', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf01e259-c072-4086-adcd-cd304f7eb4a9', 'serial': 'bf01e259-c072-4086-adcd-cd304f7eb4a9'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:48:08 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:48:08 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBlvVJQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:08 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:08 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:08 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44c923-a498-4b28-8cd2-031785f2ac33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:48:08 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edcd59d-f89b-444f-a4f2-d54926351cb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9] added
Apr 14 05:48:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ab552-7815-4749-afde-89e450ab2a1f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f95823e-5cc9-4ded-96b4-d76469cba7e9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBlvVJQp {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBlvVJQp" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce57181f-210b-474e-b9f9-7cad2184a83b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBlvVJQp'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c05b07-de7a-47de-96db-d4a7f1b88ff8]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f4c75-4ba1-4f20-bbfb-878e79a9e7d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a69bc5-d2ec-4d6d-bd71-38488f756b14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9, portal: 172.16.0.220,3260]
Apr 14 05:48:08 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dfc9fe-ebe7-4b41-8aff-8f7aebfa03e9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0148d98-db3a-4d20-bc2a-929010e2d7e1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:08 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b3bb5f-2b02-442d-a3d7-8a71b19a2688]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:48:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBlvVJQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23930363664313630', 'path': '/dev/sdh'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930363664313630', 'path': '/dev/sdh'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1009909021',display_name='tempest-TestVolumeBootPattern-server-1009909021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1009909021',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-82ea3p0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:56Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=5e607038-6c40-417e-8c4f-f73f691e8672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:78:03,bridge_name='br-int',has_traffic_filtering=True,id=0d477ae1-6e7f-4888-8f7d-8d53a41f225c,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d477ae1-6e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e607038-6c40-417e-8c4f-f73f691e8672 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:48:09 user nova-compute[71312]:   <uuid>5e607038-6c40-417e-8c4f-f73f691e8672</uuid>
Apr 14 05:48:09 user nova-compute[71312]:   <name>instance-0000000a</name>
Apr 14 05:48:09 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:48:09 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:48:09 user nova-compute[71312]:   <metadata>
Apr 14 05:48:09 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:48:09 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:48:09 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-server-1009909021</nova:name>
Apr 14 05:48:09 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:48:08</nova:creationTime>
Apr 14 05:48:09 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:48:09 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:48:09 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:48:09 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:48:09 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:48:09 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:48:09 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:48:09 user nova-compute[71312]:       <nova:owner>
Apr 14 05:48:09 user nova-compute[71312]:         <nova:user uuid="670c42ab26ab49808773a20f14269e13">tempest-TestVolumeBootPattern-2132265128-project-member</nova:user>
Apr 14 05:48:09 user nova-compute[71312]:         <nova:project uuid="8134d4bfff8e465c8dc0a5342fee7e10">tempest-TestVolumeBootPattern-2132265128</nova:project>
Apr 14 05:48:09 user nova-compute[71312]:       </nova:owner>
Apr 14 05:48:09 user nova-compute[71312]:       <nova:ports>
Apr 14 05:48:09 user nova-compute[71312]:         <nova:port uuid="0d477ae1-6e7f-4888-8f7d-8d53a41f225c">
Apr 14 05:48:09 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 05:48:09 user nova-compute[71312]:         </nova:port>
Apr 14 05:48:09 user nova-compute[71312]:       </nova:ports>
Apr 14 05:48:09 user nova-compute[71312]:     </nova:instance>
Apr 14 05:48:09 user nova-compute[71312]:   </metadata>
Apr 14 05:48:09 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:48:09 user nova-compute[71312]:     <system>
Apr 14 05:48:09 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:48:09 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:48:09 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:48:09 user nova-compute[71312]:       <entry name="serial">5e607038-6c40-417e-8c4f-f73f691e8672</entry>
Apr 14 05:48:09 user nova-compute[71312]:       <entry name="uuid">5e607038-6c40-417e-8c4f-f73f691e8672</entry>
Apr 14 05:48:09 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:48:09 user nova-compute[71312]:     </system>
Apr 14 05:48:09 user nova-compute[71312]:   </sysinfo>
Apr 14 05:48:09 user nova-compute[71312]:   <os>
Apr 14 05:48:09 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:48:09 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:48:09 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:48:09 user nova-compute[71312]:   </os>
Apr 14 05:48:09 user nova-compute[71312]:   <features>
Apr 14 05:48:09 user nova-compute[71312]:     <acpi/>
Apr 14 05:48:09 user nova-compute[71312]:     <apic/>
Apr 14 05:48:09 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:48:09 user nova-compute[71312]:   </features>
Apr 14 05:48:09 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:48:09 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:48:09 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:48:09 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:48:09 user nova-compute[71312]:   </clock>
Apr 14 05:48:09 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:48:09 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:48:09 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:48:09 user nova-compute[71312]:   </cpu>
Apr 14 05:48:09 user nova-compute[71312]:   <devices>
Apr 14 05:48:09 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:48:09 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:09 user nova-compute[71312]:       <source dev="/dev/sdh"/>
Apr 14 05:48:09 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:48:09 user nova-compute[71312]:       <serial>bf01e259-c072-4086-adcd-cd304f7eb4a9</serial>
Apr 14 05:48:09 user nova-compute[71312]:     </disk>
Apr 14 05:48:09 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:48:09 user nova-compute[71312]:       <mac address="fa:16:3e:07:78:03"/>
Apr 14 05:48:09 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:48:09 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:48:09 user nova-compute[71312]:       <target dev="tap0d477ae1-6e"/>
Apr 14 05:48:09 user nova-compute[71312]:     </interface>
Apr 14 05:48:09 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:48:09 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/5e607038-6c40-417e-8c4f-f73f691e8672/console.log" append="off"/>
Apr 14 05:48:09 user nova-compute[71312]:     </serial>
Apr 14 05:48:09 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:48:09 user nova-compute[71312]:     <video>
Apr 14 05:48:09 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:48:09 user nova-compute[71312]:     </video>
Apr 14 05:48:09 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:48:09 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:48:09 user nova-compute[71312]:     </rng>
Apr 14 05:48:09 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:48:09 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:48:09 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:48:09 user nova-compute[71312]:     </memballoon>
Apr 14 05:48:09 user nova-compute[71312]:   </devices>
Apr 14 05:48:09 user nova-compute[71312]: </domain>
Apr 14 05:48:09 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1009909021',display_name='tempest-TestVolumeBootPattern-server-1009909021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1009909021',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-82ea3p0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:47:56Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=5e607038-6c40-417e-8c4f-f73f691e8672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:78:03,bridge_name='br-int',has_traffic_filtering=True,id=0d477ae1-6e7f-4888-8f7d-8d53a41f225c,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d477ae1-6e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG os_vif [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:78:03,bridge_name='br-int',has_traffic_filtering=True,id=0d477ae1-6e7f-4888-8f7d-8d53a41f225c,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d477ae1-6e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d477ae1-6e, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d477ae1-6e, col_values=(('external_ids', {'iface-id': '0d477ae1-6e7f-4888-8f7d-8d53a41f225c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:78:03', 'vm-uuid': '5e607038-6c40-417e-8c4f-f73f691e8672'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:09 user nova-compute[71312]: INFO os_vif [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:78:03,bridge_name='br-int',has_traffic_filtering=True,id=0d477ae1-6e7f-4888-8f7d-8d53a41f225c,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d477ae1-6e')
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No VIF found with MAC fa:16:3e:07:78:03, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:48:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received event network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] Acquiring lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] No waiting events found dispatching network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:11 user nova-compute[71312]: WARNING nova.compute.manager [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received unexpected event network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance with vm_state building and task_state spawning.
Apr 14 05:48:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zopEUSPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:12 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[192602e7-cba2-4723-ae5d-9e6709f90fa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:48:12 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9d7cb4-aea7-4f37-9bb0-8c614d24b92b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3] added
Apr 14 05:48:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb965ba-9ec2-49a0-8688-725b9d5c5984]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a886796-f604-48fa-8475-47980a1cdbf7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zopEUSPd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zopEUSPd" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec006ac-a9be-4273-9a21-5c229a273817]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zopEUSPd'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0556b717-2469-480e-ab59-e09ebb04e87f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff42d72-4825-4d61-a7b8-528ddc53aadc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:12 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451293.231012, 5e607038-6c40-417e-8c4f-f73f691e8672 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] VM Resumed (Lifecycle Event)
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Instance spawned successfully.
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451293.2313962, 5e607038-6c40-417e-8c4f-f73f691e8672 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] VM Started (Lifecycle Event)
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Took 5.26 seconds to spawn the instance on the hypervisor.
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] instance snapshotting
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.compute.manager [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Took 18.24 seconds to build instance.
Apr 14 05:48:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "5e607038-6c40-417e-8c4f-f73f691e8672" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.356s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Beginning live snapshot process
Apr 14 05:48:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --login" returned: 0 in 1.109s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[69654d29-59d6-48a1-a6af-1e64164fa792]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-changed-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Refreshing instance network info cache due to event network-changed-b5de51fa-6654-4f76-89df-063a4d6ad4f0. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Refreshing network info cache for port b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3, portal: 172.16.0.220,3260]
Apr 14 05:48:14 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a56318-bfd3-4c92-b4af-a3ab7912a36e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71bb59c-f850-48bb-95be-df1c1d09aed4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 (non-flash)
Apr 14 05:48:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.400s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7zrcl_e4/92fb73f0d43d4206b370cd91ee6b178a.delta 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec08640-a32c-41bc-aac5-7d2449c70602]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zopEUSPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7zrcl_e4/92fb73f0d43d4206b370cd91ee6b178a.delta 1073741824" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 05:48:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71312) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 05:48:14 user nova-compute[71312]: INFO nova.virt.libvirt.host [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] UEFI support detected
Apr 14 05:48:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updated VIF entry in instance network info cache for port b5de51fa-6654-4f76-89df-063a4d6ad4f0. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received event network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Acquiring lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] No waiting events found dispatching network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:14 user nova-compute[71312]: WARNING nova.compute.manager [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received unexpected event network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance with vm_state active and task_state None.
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.493s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] <== connect_volume: return (2494ms) {'type': 'block', 'scsi_wwn': '23165653862366636', 'path': '/dev/sdi'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165653862366636', 'path': '/dev/sdi'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lazy-loading 'flavor' on Instance uuid 91642571-ef07-4990-bdf8-068203203d59 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:48:15 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:15 user nova-compute[71312]:   <source dev="/dev/sdi"/>
Apr 14 05:48:15 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:48:15 user nova-compute[71312]:   <serial>499d646d-6940-4a45-a551-4df4745e44f3</serial>
Apr 14 05:48:15 user nova-compute[71312]: </disk>
Apr 14 05:48:15 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7zrcl_e4/92fb73f0d43d4206b370cd91ee6b178a.delta /opt/stack/data/nova/instances/snapshots/tmp7zrcl_e4/92fb73f0d43d4206b370cd91ee6b178a {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] No VIF found with MAC fa:16:3e:45:4b:ca, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:48:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.636s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7zrcl_e4/92fb73f0d43d4206b370cd91ee6b178a.delta /opt/stack/data/nova/instances/snapshots/tmp7zrcl_e4/92fb73f0d43d4206b370cd91ee6b178a" returned: 0 in 0.384s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Snapshot extracted, beginning image upload
Apr 14 05:48:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:17 user nova-compute[71312]: INFO nova.compute.manager [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Terminating instance
Apr 14 05:48:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received event network-vif-unplugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] Lock "91642571-ef07-4990-bdf8-068203203d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] Lock "91642571-ef07-4990-bdf8-068203203d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] No waiting events found dispatching network-vif-unplugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received event network-vif-unplugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:48:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 91642571-ef07-4990-bdf8-068203203d59] Instance destroyed successfully.
Apr 14 05:48:18 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lazy-loading 'resources' on Instance uuid 91642571-ef07-4990-bdf8-068203203d59 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-903134627',display_name='tempest-DeleteServersTestJSON-server-903134627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-903134627',id=1,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='115d9f93613748fe825f46c46e59c1d1',ramdisk_id='',reservation_id='r-nc7p4qnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1472969533',owner_user_name='tempest-DeleteServersTestJSON-1472969533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:46:31Z,user_data=None,user_id='c5ac7cb2e42e403b998381759f922e9f',uuid=91642571-ef07-4990-bdf8-068203203d59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Converting VIF {"id": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "address": "fa:16:3e:45:4b:ca", "network": {"id": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1460158309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "115d9f93613748fe825f46c46e59c1d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb9f34b-1d", "ovs_interfaceid": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=7cb9f34b-1d26-4234-acfd-9c6252d4dcbd,network=Network(f17fe600-6a0b-44d9-a761-cfa2fd5b7515),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb9f34b-1d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_vif [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=7cb9f34b-1d26-4234-acfd-9c6252d4dcbd,network=Network(f17fe600-6a0b-44d9-a761-cfa2fd5b7515),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb9f34b-1d') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cb9f34b-1d, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:48:18 user nova-compute[71312]: INFO os_vif [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=7cb9f34b-1d26-4234-acfd-9c6252d4dcbd,network=Network(f17fe600-6a0b-44d9-a761-cfa2fd5b7515),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb9f34b-1d')
Apr 14 05:48:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zopEUSPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:18 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb3b058-acde-450b-aa42-8ef8d4c4b709]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:48:18 user nova-compute[71312]: No targets found.
Apr 14 05:48:18 user nova-compute[71312]: iSNS:
Apr 14 05:48:18 user nova-compute[71312]: No targets found.
Apr 14 05:48:18 user nova-compute[71312]: STATIC:
Apr 14 05:48:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:48:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:18 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:48:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:18 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a
Apr 14 05:48:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:18 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:48:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:18 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:48:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:18 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3
Apr 14 05:48:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:18 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8
Apr 14 05:48:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:18 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:18 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66
Apr 14 05:48:18 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:18 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:18 user nova-compute[71312]: FIRMWARE:
Apr 14 05:48:18 user nova-compute[71312]: No targets found.
Apr 14 05:48:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:48:18 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:48:18 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8190d4ed-b37b-4c49-87af-a96007db314f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6a89d5-5e7c-40c5-bbb3-42723fd93804]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 (non-flash)
Apr 14 05:48:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc1ac040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3'): ({'sdi'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Removing single pathed devices sdi {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e2563b-1fff-4b05-b603-33cc0e98f1f6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11d997e-5fee-4442-93c3-1e53daf404ed]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Flushing IO for device /dev/sdi {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00db0bd-cc74-4159-995c-b2f7c2786d01]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.059s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df38c44-a679-4bc6-85da-ab4bd819995d]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] SCSI volumes sdi have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24f098-d731-4ee0-bea4-0af0c0dc5103]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Snapshot image upload complete
Apr 14 05:48:18 user nova-compute[71312]: INFO nova.compute.manager [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Took 5.03 seconds to snapshot the instance on the hypervisor.
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b79b85-861c-4617-8440-96c28ff51f72]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3, portal: 172.16.0.220,3260]
Apr 14 05:48:18 user nova-compute[71312]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:18 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:499d646d-6940-4a45-a551-4df4745e44f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbe119c-d74f-4c70-a2c0-2e63b35f105c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] <== disconnect_volume: return (380ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:48:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Deleting instance files /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59_del
Apr 14 05:48:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Deletion of /opt/stack/data/nova/instances/91642571-ef07-4990-bdf8-068203203d59_del complete
Apr 14 05:48:18 user nova-compute[71312]: INFO nova.compute.manager [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 14 05:48:18 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 91642571-ef07-4990-bdf8-068203203d59] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:48:18 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 91642571-ef07-4990-bdf8-068203203d59] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:48:19 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 91642571-ef07-4990-bdf8-068203203d59] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:19 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 91642571-ef07-4990-bdf8-068203203d59] Took 0.54 seconds to deallocate network for instance.
Apr 14 05:48:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received event network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Acquiring lock "91642571-ef07-4990-bdf8-068203203d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Lock "91642571-ef07-4990-bdf8-068203203d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Lock "91642571-ef07-4990-bdf8-068203203d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] No waiting events found dispatching network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:19 user nova-compute[71312]: WARNING nova.compute.manager [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received unexpected event network-vif-plugged-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance with vm_state active and task_state deleting.
Apr 14 05:48:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] [instance: 91642571-ef07-4990-bdf8-068203203d59] Received event network-vif-deleted-7cb9f34b-1d26-4234-acfd-9c6252d4dcbd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:19 user nova-compute[71312]: INFO nova.compute.manager [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Took 0.83 seconds to detach 1 volumes for instance.
Apr 14 05:48:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:20 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:48:20 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:48:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.602s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:20 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Deleted allocations for instance 91642571-ef07-4990-bdf8-068203203d59
Apr 14 05:48:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "91642571-ef07-4990-bdf8-068203203d59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.431s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:33 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451298.0765028, 91642571-ef07-4990-bdf8-068203203d59 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:48:33 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 91642571-ef07-4990-bdf8-068203203d59] VM Stopped (Lifecycle Event)
Apr 14 05:48:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c3bc696-3244-4d82-b40d-898271c92c54 None None] [instance: 91642571-ef07-4990-bdf8-068203203d59] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:48:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received event network-changed-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Refreshing instance network info cache due to event network-changed-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:48:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] Acquiring lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] Acquired lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Refreshing network info cache for port a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:48:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updated VIF entry in instance network info cache for port a9abbeea-538e-4cf6-96b0-71fdeec1f2c3. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:48:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updating instance_info_cache with network_info: [{"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] Releasing lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-changed-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Refreshing instance network info cache due to event network-changed-b5264ebc-31b1-434f-b555-abcbebb4c6e2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:48:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] Acquiring lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] Acquired lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Refreshing network info cache for port b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lazy-loading 'flavor' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "interface-b91c97cd-ba56-4cd7-845d-28e6c9f37836-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "interface-b91c97cd-ba56-4cd7-845d-28e6c9f37836-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'flavor' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:37 user nova-compute[71312]: INFO nova.compute.manager [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Attaching volume 5d5e24bd-9225-4eb3-8359-d4c380c66e0d to /dev/vdb
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.utils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9067f368-4766-408e-82c6-0d6d2d9316c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'pci_requests' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c686ced5-4c62-495f-b638-be93f28d3742]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'flavor' on Instance uuid 932e9aba-ecce-4d2e-8486-eb2e3c685403 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d1264f-693b-4096-91c7-80ad8bbdf9a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5179c54-1694-495f-adab-6fb3fd026508]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:37 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e16b49a-ccc6-416f-890b-f5a9cedd81d8]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.utils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Updating existing volume attachment record: b8cbc647-3f3f-4530-9ec3-f95c4df4f323 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.policy [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:37 user nova-compute[71312]: INFO nova.compute.manager [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Attaching volume daca84b5-035a-4aaa-98b5-a7b193293fac to /dev/vdb
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.utils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[114dc824-2434-4360-b317-9b17c757e82c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b2622-7a26-4e15-b41c-67f6bfb966c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37bde5-4823-4181-996c-f0851e9e2434]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e141e-eefd-47cc-9847-5390653eb62f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updated VIF entry in instance network info cache for port b5264ebc-31b1-434f-b555-abcbebb4c6e2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating instance_info_cache with network_info: [{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:37 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c65946-beb4-4008-b30f-f463212fe4a4]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG os_brick.utils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updating existing volume attachment record: 7501ef8f-dce5-4db3-b7bf-24b43e3d1c63 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:48:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] Releasing lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received event network-changed-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Refreshing instance network info cache due to event network-changed-5f81b5ce-2c7e-4901-953e-a39739dd26db. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] Acquiring lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] Acquired lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Refreshing network info cache for port 5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Successfully created port: c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Updated VIF entry in instance network info cache for port 5f81b5ce-2c7e-4901-953e-a39739dd26db. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Updating instance_info_cache with network_info: [{"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] Releasing lock "refresh_cache-4f0881a2-86a2-40e5-8c3a-1ca12da65aae" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received event network-changed-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Refreshing instance network info cache due to event network-changed-fd4d27b7-aa72-41ed-8d91-6410737250a7. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] Acquiring lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] Acquired lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Refreshing network info cache for port fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Successfully updated port: c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquired lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.neutron [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Updated VIF entry in instance network info cache for port fd4d27b7-aa72-41ed-8d91-6410737250a7. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.neutron [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Updating instance_info_cache with network_info: [{"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] Releasing lock "refresh_cache-a7fd3290-73e1-438e-9301-4a668e50c3be" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating instance_info_cache with network_info: [{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Releasing lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converting VIF {"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG os_vif [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc32e89f7-51, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc32e89f7-51, col_values=(('external_ids', {'iface-id': 'c32e89f7-517b-48a5-a592-61d3685581b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:4a:89', 'vm-uuid': 'b91c97cd-ba56-4cd7-845d-28e6c9f37836'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:39 user nova-compute[71312]: INFO os_vif [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51')
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converting VIF {"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] attach device xml: <interface type="ethernet">
Apr 14 05:48:39 user nova-compute[71312]:   <mac address="fa:16:3e:c0:4a:89"/>
Apr 14 05:48:39 user nova-compute[71312]:   <model type="virtio"/>
Apr 14 05:48:39 user nova-compute[71312]:   <mtu size="1442"/>
Apr 14 05:48:39 user nova-compute[71312]:   <target dev="tapc32e89f7-51"/>
Apr 14 05:48:39 user nova-compute[71312]: </interface>
Apr 14 05:48:39 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:48:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lazy-loading 'flavor' on Instance uuid 4f0881a2-86a2-40e5-8c3a-1ca12da65aae {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No VIF found with MAC fa:16:3e:1d:f8:9d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:48:40 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Apr 14 05:48:40 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-2066307036</nova:name>
Apr 14 05:48:40 user nova-compute[71312]:   <nova:creationTime>2023-04-14 05:48:40</nova:creationTime>
Apr 14 05:48:40 user nova-compute[71312]:   <nova:flavor name="m1.nano">
Apr 14 05:48:40 user nova-compute[71312]:     <nova:memory>128</nova:memory>
Apr 14 05:48:40 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Apr 14 05:48:40 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Apr 14 05:48:40 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:48:40 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Apr 14 05:48:40 user nova-compute[71312]:   </nova:flavor>
Apr 14 05:48:40 user nova-compute[71312]:   <nova:owner>
Apr 14 05:48:40 user nova-compute[71312]:     <nova:user uuid="a1d16c8d82ea4d38b34bef8f1a9e9f92">tempest-TaggedAttachmentsTest-1560780204-project-member</nova:user>
Apr 14 05:48:40 user nova-compute[71312]:     <nova:project uuid="5f62071417bf445d8982419fb3cfb625">tempest-TaggedAttachmentsTest-1560780204</nova:project>
Apr 14 05:48:40 user nova-compute[71312]:   </nova:owner>
Apr 14 05:48:40 user nova-compute[71312]:   <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:48:40 user nova-compute[71312]:   <nova:ports>
Apr 14 05:48:40 user nova-compute[71312]:     <nova:port uuid="b5264ebc-31b1-434f-b555-abcbebb4c6e2">
Apr 14 05:48:40 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:48:40 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:40 user nova-compute[71312]:     <nova:port uuid="c32e89f7-517b-48a5-a592-61d3685581b0">
Apr 14 05:48:40 user nova-compute[71312]:       <nova:ip type="fixed" address="10.10.10.68" ipVersion="4"/>
Apr 14 05:48:40 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:40 user nova-compute[71312]:   </nova:ports>
Apr 14 05:48:40 user nova-compute[71312]: </nova:instance>
Apr 14 05:48:40 user nova-compute[71312]:  {{(pid=71312) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "interface-b91c97cd-ba56-4cd7-845d-28e6c9f37836-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.254s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:40 user nova-compute[71312]: INFO nova.compute.manager [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Attaching volume 231936ce-a3ba-4ab6-8461-ea35634886f0 to /dev/sdc
Apr 14 05:48:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG os_brick.utils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c5f48d-f5ec-493a-aa5a-505225156a34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a3ca8-dd4e-4cbc-a3c9-a2d448a0ce81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7da1663-841c-4c70-80db-4d3123394321]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5646dc1d-bf77-42f3-b23c-3dd5fb8a07f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:40 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f72811c-1594-464f-b20e-d6874d68ac2f]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG os_brick.utils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Updating existing volume attachment record: 520c470e-3c25-4d1a-b76e-bf62208e6d46 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'flavor' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-changed-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Refreshing instance network info cache due to event network-changed-c32e89f7-517b-48a5-a592-61d3685581b0. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Acquiring lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Acquired lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Refreshing network info cache for port c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updated VIF entry in instance network info cache for port c32e89f7-517b-48a5-a592-61d3685581b0. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating instance_info_cache with network_info: [{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Releasing lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] No waiting events found dispatching network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:41 user nova-compute[71312]: WARNING nova.compute.manager [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received unexpected event network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 for instance with vm_state active and task_state None.
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] No waiting events found dispatching network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:41 user nova-compute[71312]: WARNING nova.compute.manager [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received unexpected event network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 for instance with vm_state active and task_state None.
Apr 14 05:48:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:42 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa16aabc-9c5f-43c3-a6b4-dd66a9807a90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:48:42 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c7c989-74c2-4e5c-92d8-ea503ffb3460]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d] added
Apr 14 05:48:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2252974a-fedc-4e6c-948e-514b6ef49347]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d259c8-7789-46f2-8589-2e8c104cdd10]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvQHLcGM {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvQHLcGM" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b49dbac-d8f6-41d4-8107-0c9f863feab9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NvQHLcGM'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc318c-921a-40ba-849a-93f95dc5c2b0]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aafce9-12c3-49d2-a5dd-5c36d14df7b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ca39b-7cd1-41a1-9e2c-f21051e3de4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260]
Apr 14 05:48:42 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b0a6a9-25bb-4563-be0f-39c642442421]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:42 user nova-compute[71312]: INFO nova.compute.manager [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Attaching volume 2b228e9f-b052-4cab-9482-b8e50b290a9a to /dev/vdb
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:42 user nova-compute[71312]: INFO nova.compute.manager [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Terminating instance
Apr 14 05:48:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1261ba20-1ebf-4c90-98ec-09841fa76ed3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:42 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaae739-8483-4f46-9241-3d0dcd3d2c76]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqODwGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.utils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe99e64d-99f3-4f58-bb28-ff09e423417b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7fb93e-97d8-4b58-b08f-830b0c8816e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d84c6b8-e10e-444e-8a66-130f52bef9cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c2772-e4ae-4a02-a961-a0012e4c5dfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:43 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9367a60-150f-46e9-89e2-2f019fb4023a]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.utils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating existing volume attachment record: e5dc8b6a-dce3-4f0d-b6ee-905a7e4420f0 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received event network-vif-unplugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] Acquiring lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] No waiting events found dispatching network-vif-unplugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received event network-vif-unplugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:48:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Instance destroyed successfully.
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lazy-loading 'resources' on Instance uuid 1dc51328-8af2-4ddf-88e1-40cbba7a2823 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1106076483',display_name='tempest-VolumesActionsTest-instance-1106076483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1106076483',id=4,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e9e42476ce14c31a05897a4a738ffd4',ramdisk_id='',reservation_id='r-6yl010t6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2128027182',owner_user_name='tempest-VolumesActionsTest-2128027182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:01Z,user_data=None,user_id='00dda4002041403eade471624793359c',uuid=1dc51328-8af2-4ddf-88e1-40cbba7a2823,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Converting VIF {"id": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "address": "fa:16:3e:3e:a8:ff", "network": {"id": "977dfb64-b72b-4f61-b628-2531e911dd6e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394266886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6e9e42476ce14c31a05897a4a738ffd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8452cfda-61", "ovs_interfaceid": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=8452cfda-611d-4d2b-9976-e4fe1f7eb92d,network=Network(977dfb64-b72b-4f61-b628-2531e911dd6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8452cfda-61') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_vif [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=8452cfda-611d-4d2b-9976-e4fe1f7eb92d,network=Network(977dfb64-b72b-4f61-b628-2531e911dd6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8452cfda-61') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8452cfda-61, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:48:43 user nova-compute[71312]: INFO os_vif [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=8452cfda-611d-4d2b-9976-e4fe1f7eb92d,network=Network(977dfb64-b72b-4f61-b628-2531e911dd6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8452cfda-61')
Apr 14 05:48:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Deleting instance files /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823_del
Apr 14 05:48:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Deletion of /opt/stack/data/nova/instances/1dc51328-8af2-4ddf-88e1-40cbba7a2823_del complete
Apr 14 05:48:43 user nova-compute[71312]: INFO nova.compute.manager [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23431393136363933', 'path': '/dev/sdi'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431393136363933', 'path': '/dev/sdi'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.944s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:43 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:43 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lazy-loading 'flavor' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3cad67-03b6-4ea0-a356-47a55c56c5fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:48:43 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:48:43 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:43 user nova-compute[71312]:   <source dev="/dev/sdi"/>
Apr 14 05:48:43 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:48:43 user nova-compute[71312]:   <serial>5d5e24bd-9225-4eb3-8359-d4c380c66e0d</serial>
Apr 14 05:48:43 user nova-compute[71312]: </disk>
Apr 14 05:48:43 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56d4314-9b08-4169-a550-ccf281ef8d1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac] added
Apr 14 05:48:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e2b2e-4663-4d3a-ba4f-a7b3f9e71395]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d584931-b334-447b-9e41-00385820183f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laqODwGH {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laqODwGH" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edcf60d-b1c6-4906-9c05-b5e10471c24d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'laqODwGH'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5721de-eed3-4971-b1e0-ec0ac0b059c3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e2536-7e5d-4093-a95e-c7629688c9f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[950addeb-ac79-4328-9e79-593ed4d8052e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac, portal: 172.16.0.220,3260]
Apr 14 05:48:44 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[77241979-565b-4b9a-a311-6a5fa7915cef]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6731d72c-650d-4b8e-852d-1609b9316c98]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:44 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:44 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b10f9b-6de9-415f-b2d6-1e4e89453a0c]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqODwGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] No VIF found with MAC fa:16:3e:ce:95:6c, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:44 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Took 0.62 seconds to deallocate network for instance.
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received event network-vif-deleted-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:44 user nova-compute[71312]: INFO nova.compute.manager [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Neutron deleted interface 8452cfda-611d-4d2b-9976-e4fe1f7eb92d; detaching it from the instance and deleting it from the info cache
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.network.neutron [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Detach interface failed, port_id=8452cfda-611d-4d2b-9976-e4fe1f7eb92d, reason: Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.296s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:48:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:44 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Deleted allocations for instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.204s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received event network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] Acquiring lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] Lock "1dc51328-8af2-4ddf-88e1-40cbba7a2823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] No waiting events found dispatching network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:45 user nova-compute[71312]: WARNING nova.compute.manager [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Received unexpected event network-vif-plugged-8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance with vm_state deleted and task_state None.
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] <== connect_volume: return (2351ms) {'type': 'block', 'scsi_wwn': '23233653336623765', 'path': '/dev/sdj'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233653336623765', 'path': '/dev/sdj'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'flavor' on Instance uuid 932e9aba-ecce-4d2e-8486-eb2e3c685403 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:48:45 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:45 user nova-compute[71312]:   <source dev="/dev/sdj"/>
Apr 14 05:48:45 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:48:45 user nova-compute[71312]:   <serial>daca84b5-035a-4aaa-98b5-a7b193293fac</serial>
Apr 14 05:48:45 user nova-compute[71312]: </disk>
Apr 14 05:48:45 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.utils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ef6756-a44e-4e7c-ac63-8ed1e57dcbfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e170f9a-0fbf-4483-8062-fd7f50e5459e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d914204-4211-4e93-a7c6-723cb1866526]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad6fd3e-9f42-471f-9cd2-6635e1191ad8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:45 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9466bbed-39e7-45ab-aa8f-6ea13819acf8]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.utils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:45 user nova-compute[71312]: INFO nova.compute.manager [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Swapping volume 5d5e24bd-9225-4eb3-8359-d4c380c66e0d for 8c38aa08-6830-4cc2-a66f-76daa76f9c10
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhsIMxyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:45 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] No VIF found with MAC fa:16:3e:26:b9:59, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[455886b6-d54c-45fa-9ec6-f49b35ae74c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:48:45 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[39862acf-c531-437a-84bb-e80b61e55ebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0] added
Apr 14 05:48:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc5a63f-c2a8-4fdf-bf27-9298541b2cb9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f39c603-b8f5-46b1-bc7e-1c771da8d01a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhsIMxyE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhsIMxyE" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a9df9-8042-426d-81af-6a834f570d41]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rhsIMxyE'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[354053f2-468c-4542-9a18-69e5fe53f3d1]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.181s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a656b1f6-1289-4600-be6b-3d4bb1ad5a9d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:45 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0702be2f-8ed4-45de-8684-d6bf98371e5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0, portal: 172.16.0.220,3260]
Apr 14 05:48:46 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed06660a-c98a-431b-9b5e-061b3406772f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d18079-b723-4069-bc10-b9ae35000806]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:46 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca9aeba-120b-46ea-b398-c006554df8fe]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhsIMxyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:48:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23831353062663335', 'path': '/dev/sdk'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831353062663335', 'path': '/dev/sdk'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lazy-loading 'flavor' on Instance uuid 4f0881a2-86a2-40e5-8c3a-1ca12da65aae {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:48:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:47 user nova-compute[71312]:   <source dev="/dev/sdk"/>
Apr 14 05:48:47 user nova-compute[71312]:   <target dev="sdc" bus="scsi"/>
Apr 14 05:48:47 user nova-compute[71312]:   <serial>231936ce-a3ba-4ab6-8461-ea35634886f0</serial>
Apr 14 05:48:47 user nova-compute[71312]:   <address type="drive" controller="0" unit="2"/>
Apr 14 05:48:47 user nova-compute[71312]: </disk>
Apr 14 05:48:47 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] No BDM found with device name sda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] No VIF found with MAC fa:16:3e:d2:c8:59, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:47 user nova-compute[71312]: INFO nova.compute.manager [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Detaching volume daca84b5-035a-4aaa-98b5-a7b193293fac
Apr 14 05:48:47 user nova-compute[71312]: INFO nova.virt.block_device [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Attempting to driver detach volume daca84b5-035a-4aaa-98b5-a7b193293fac from mountpoint /dev/vdb
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Attempting to detach device vdb from instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:48:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:47 user nova-compute[71312]:   <source dev="/dev/sdj"/>
Apr 14 05:48:47 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:48:47 user nova-compute[71312]:   <serial>daca84b5-035a-4aaa-98b5-a7b193293fac</serial>
Apr 14 05:48:47 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:48:47 user nova-compute[71312]: </disk>
Apr 14 05:48:47 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:48:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Successfully detached device vdb from instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 from the persistent domain config.
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:48:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:47 user nova-compute[71312]:   <source dev="/dev/sdj"/>
Apr 14 05:48:47 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:48:47 user nova-compute[71312]:   <serial>daca84b5-035a-4aaa-98b5-a7b193293fac</serial>
Apr 14 05:48:47 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:48:47 user nova-compute[71312]: </disk>
Apr 14 05:48:47 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:48:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.357s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGxXgilP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:48 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:48 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:48 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f65487-f5da-4e7a-b4f2-1f4ef3179c62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:48:48 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55cabf7-8906-43d0-9be7-6b1a4c9375d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a] added
Apr 14 05:48:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cca90d-dff5-4607-ae38-fe3391de6bc0]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451328.2856538, 932e9aba-ecce-4d2e-8486-eb2e3c685403 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Successfully detached device vdb from instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 from the live domain config.
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqODwGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:48 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[df65583e-6179-4abe-a5b0-288f075e1997]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGxXgilP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGxXgilP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf8803b-327f-451c-b1f3-28990710aea7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGxXgilP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9769cafc-2a48-4fad-91a7-1d8b11721180]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff137234-c7a3-4dc1-a494-589958fa8a07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[085f02a3-4936-4e9b-a5e9-bee40318e15c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a, portal: 172.16.0.220,3260]
Apr 14 05:48:48 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:48 user nova-compute[71312]: INFO nova.compute.manager [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Detaching volume 231936ce-a3ba-4ab6-8461-ea35634886f0
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65916389-4fbe-4c88-bfa4-0577f92dad00]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cc93f8-c1b6-428a-9c29-f3f7f338accf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:48 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:48 user nova-compute[71312]: INFO nova.virt.block_device [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Attempting to driver detach volume 231936ce-a3ba-4ab6-8461-ea35634886f0 from mountpoint /dev/sdc
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Attempting to detach device sdc from instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:48:48 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:48 user nova-compute[71312]:   <source dev="/dev/sdk"/>
Apr 14 05:48:48 user nova-compute[71312]:   <target dev="sdc" bus="scsi"/>
Apr 14 05:48:48 user nova-compute[71312]:   <serial>231936ce-a3ba-4ab6-8461-ea35634886f0</serial>
Apr 14 05:48:48 user nova-compute[71312]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 05:48:48 user nova-compute[71312]: </disk>
Apr 14 05:48:48 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f4dbf3-5905-465c-84df-0cfb2e0df740]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGxXgilP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:48:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Successfully detached device sdc from instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae from the persistent domain config.
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:48:48 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:48 user nova-compute[71312]:   <source dev="/dev/sdk"/>
Apr 14 05:48:48 user nova-compute[71312]:   <target dev="sdc" bus="scsi"/>
Apr 14 05:48:48 user nova-compute[71312]:   <serial>231936ce-a3ba-4ab6-8461-ea35634886f0</serial>
Apr 14 05:48:48 user nova-compute[71312]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 05:48:48 user nova-compute[71312]: </disk>
Apr 14 05:48:48 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451328.983628, 4f0881a2-86a2-40e5-8c3a-1ca12da65aae => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:48:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Successfully detached device sdc from instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae from the live domain config.
Apr 14 05:48:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhsIMxyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:48 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23931383733626535', 'path': '/dev/sdl'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931383733626535', 'path': '/dev/sdl'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.301s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'flavor' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fda042f-fd4b-4a1a-aa3b-e8f3b5dd2a2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:48:49 user nova-compute[71312]: No targets found.
Apr 14 05:48:49 user nova-compute[71312]: iSNS:
Apr 14 05:48:49 user nova-compute[71312]: No targets found.
Apr 14 05:48:49 user nova-compute[71312]: STATIC:
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: FIRMWARE:
Apr 14 05:48:49 user nova-compute[71312]: No targets found.
Apr 14 05:48:49 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:48:49 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:48:49 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:48:49 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:49 user nova-compute[71312]:   <source dev="/dev/sdl"/>
Apr 14 05:48:49 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:48:49 user nova-compute[71312]:   <serial>2b228e9f-b052-4cab-9482-b8e50b290a9a</serial>
Apr 14 05:48:49 user nova-compute[71312]: </disk>
Apr 14 05:48:49 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf00b0ed-3df8-42db-b192-8d75b6f2ebc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b11eb8-108b-4351-93d5-4d5858b173cf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:49 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:49 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc1af5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac'): ({'sdj'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Removing single pathed devices sdj {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce9b9f-9769-4a17-8d61-dd2f46de7beb]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2c349-69c5-4d53-8d71-851614e19978]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flushing IO for device /dev/sdj {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dc2c46-faf1-4f3c-98b9-ec76f8b28abf]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.033s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd615940-e0b4-4f99-8b99-d8d9aee9d087]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] SCSI volumes sdj have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f02355-3d78-45fb-9063-6a52b5431ec9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a523bf0-5832-4f62-82e4-11f9627c4666]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac, portal: 172.16.0.220,3260]
Apr 14 05:48:49 user nova-compute[71312]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:49 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daca84b5-035a-4aaa-98b5-a7b193293fac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880cbf0-d918-48c5-8587-378a2af8931a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] <== disconnect_volume: return (1650ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.968s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7383b6-73a2-46e5-a8b5-7d15228155dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:48:49 user nova-compute[71312]: No targets found.
Apr 14 05:48:49 user nova-compute[71312]: iSNS:
Apr 14 05:48:49 user nova-compute[71312]: No targets found.
Apr 14 05:48:49 user nova-compute[71312]: STATIC:
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66
Apr 14 05:48:49 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:49 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:49 user nova-compute[71312]: FIRMWARE:
Apr 14 05:48:49 user nova-compute[71312]: No targets found.
Apr 14 05:48:49 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:48:49 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:48:49 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:48:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[87369d9b-9f94-46ef-aca8-00ef7690924b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b764746-beff-4ecd-9e9e-037357b063f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea255ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0'): ({'sdk'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Removing single pathed devices sdk {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No BDM found with device name hda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] No VIF found with MAC fa:16:3e:1d:f8:9d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3078f1-ba94-4c68-9602-63529c70adf4]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2935db-5d43-45c1-8f51-9e2bc638532d]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Flushing IO for device /dev/sdk {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[589279e4-68ec-4735-8f5e-54edf3b25d42]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.051s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8b8c13-88f6-427d-869b-b8f8ec4560af]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] SCSI volumes sdk have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a2666d-57cc-4080-91c7-a731b555ccf7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.416s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed29836-487d-4a73-a1ca-84e011b40575]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0, portal: 172.16.0.220,3260]
Apr 14 05:48:50 user nova-compute[71312]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLcvJQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7fd3290-73e1-438e-9301-4a668e50c3be', 'attached_at': '', 'detached_at': '', 'volume_id': '8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'serial': '8c38aa08-6830-4cc2-a66f-76daa76f9c10'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'a7fd3290-73e1-438e-9301-4a668e50c3be', 'attached_at': '', 'detached_at': '', 'volume_id': '5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'serial'} {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231936ce-a3ba-4ab6-8461-ea35634886f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b861d5e-8779-45db-9ab8-b7d598b89874]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] <== disconnect_volume: return (1346ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLcvJQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:50 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:50 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:50 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff83411-1970-463c-bc93-1bb6cbb56cb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:48:50 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfff22e-6c5b-43c6-898c-83e1f4747814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10] added
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb85bfb-b065-41f8-9102-7559f636535f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c04870-27d6-42ff-a347-daad7ae17583]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVLcvJQf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVLcvJQf" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae5791-9885-44f3-a44e-9661e8e014bf]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aVLcvJQf'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c31f87-f062-4d40-ac01-c9e2e8e24415]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac98f83-9afd-401b-b71e-163ed84323f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa48a10-efcc-43f5-abe6-11c465e900eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10, portal: 172.16.0.220,3260]
Apr 14 05:48:50 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bf7e56-f10e-4a62-8bc3-19e4542cf561]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec53e6a8-af09-4aad-a496-20e4dfec35a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:50 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:50 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb6c35-8058-4ddb-950d-fbb1c24d233e]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLcvJQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'flavor' on Instance uuid 932e9aba-ecce-4d2e-8486-eb2e3c685403 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.193s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:51 user nova-compute[71312]: INFO nova.compute.manager [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Detaching volume 2b228e9f-b052-4cab-9482-b8e50b290a9a
Apr 14 05:48:51 user nova-compute[71312]: INFO nova.virt.block_device [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Attempting to driver detach volume 2b228e9f-b052-4cab-9482-b8e50b290a9a from mountpoint /dev/vdb
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Attempting to detach device vdb from instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:48:51 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:51 user nova-compute[71312]:   <source dev="/dev/sdl"/>
Apr 14 05:48:51 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:48:51 user nova-compute[71312]:   <serial>2b228e9f-b052-4cab-9482-b8e50b290a9a</serial>
Apr 14 05:48:51 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 05:48:51 user nova-compute[71312]: </disk>
Apr 14 05:48:51 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:48:51 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Successfully detached device vdb from instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 from the persistent domain config.
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:48:51 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:48:51 user nova-compute[71312]:   <source dev="/dev/sdl"/>
Apr 14 05:48:51 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:48:51 user nova-compute[71312]:   <serial>2b228e9f-b052-4cab-9482-b8e50b290a9a</serial>
Apr 14 05:48:51 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 05:48:51 user nova-compute[71312]: </disk>
Apr 14 05:48:51 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.objects.instance [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lazy-loading 'flavor' on Instance uuid 4f0881a2-86a2-40e5-8c3a-1ca12da65aae {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.880s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451331.6986723, b91c97cd-ba56-4cd7-845d-28e6c9f37836 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:48:51 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Successfully detached device vdb from instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 from the live domain config.
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGxXgilP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:51 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23133656332306232', 'path': '/dev/sdj'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133656332306232', 'path': '/dev/sdj'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.035s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG nova.objects.instance [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lazy-loading 'flavor' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da445d9d-a460-42ae-a87c-1b5c1fe711f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:48:51 user nova-compute[71312]: No targets found.
Apr 14 05:48:51 user nova-compute[71312]: iSNS:
Apr 14 05:48:51 user nova-compute[71312]: No targets found.
Apr 14 05:48:51 user nova-compute[71312]: STATIC:
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66
Apr 14 05:48:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:51 user nova-compute[71312]: FIRMWARE:
Apr 14 05:48:51 user nova-compute[71312]: No targets found.
Apr 14 05:48:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:48:51 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:48:51 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90666a4-b0a4-44a7-94ba-a2d727bbc406]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55427443-337c-4cd7-a04f-8537d39bbb11]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:51 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc25d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a'): ({'sdl'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Removing single pathed devices sdl {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb1aaf-b2cf-4402-a225-ec3e9ec3b676]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e5a14-d793-45ea-badd-af1f2272d1b1]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Flushing IO for device /dev/sdl {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[49843300-b557-403a-85a3-1b95c19fb20a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.038s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d3cfd0-459b-492e-83a9-eecd8a276779]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] SCSI volumes sdl have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f863434-044d-4e65-8096-89b86b500487]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29979ce3-b0ba-4e49-bfb6-75768479efa5]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a, portal: 172.16.0.220,3260]
Apr 14 05:48:52 user nova-compute[71312]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:52 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b228e9f-b052-4cab-9482-b8e50b290a9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8e2f27-a78f-438e-bff5-e38a0bff7300]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] <== disconnect_volume: return (380ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:52 user nova-compute[71312]: INFO nova.compute.manager [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Terminating instance
Apr 14 05:48:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received event network-vif-unplugged-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] No waiting events found dispatching network-vif-unplugged-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received event network-vif-unplugged-5f81b5ce-2c7e-4901-953e-a39739dd26db for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:48:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 56623104 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Instance destroyed successfully.
Apr 14 05:48:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lazy-loading 'resources' on Instance uuid 4f0881a2-86a2-40e5-8c3a-1ca12da65aae {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-760918348',display_name='tempest-AttachSCSIVolumeTestJSON-server-760918348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-760918348',id=7,image_ref='265edea0-b46f-44ae-909b-198c71b4c8d1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7C9zWhHZvnaWFVobD0Mnfae2MSh5KaphNMZEvkfDqUhYz9gHy8VtkwzvotmLNtawW1HnxqUmpmcDAoolytTyapEaauUuRr5cFa5KaitiSsx6sUpMZWQHwqw1maXBxIbQ==',key_name='tempest-keypair-242182190',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dec916486c6643bebea6707752266f8d',ramdisk_id='',reservation_id='r-hfnm02j7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='265edea0-b46f-44ae-909b-198c71b4c8d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-568843138',owner_user_name='tempest-AttachSCSIVolumeTestJSON-568843138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3721f81d2a41dc9493325afb204147',uuid=4f0881a2-86a2-40e5-8c3a-1ca12da65aae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Converting VIF {"id": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "address": "fa:16:3e:d2:c8:59", "network": {"id": "a6fc7cf2-83ce-4137-8e63-a6316989706b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-402107883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dec916486c6643bebea6707752266f8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f81b5ce-2c", "ovs_interfaceid": "5f81b5ce-2c7e-4901-953e-a39739dd26db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c8:59,bridge_name='br-int',has_traffic_filtering=True,id=5f81b5ce-2c7e-4901-953e-a39739dd26db,network=Network(a6fc7cf2-83ce-4137-8e63-a6316989706b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f81b5ce-2c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG os_vif [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c8:59,bridge_name='br-int',has_traffic_filtering=True,id=5f81b5ce-2c7e-4901-953e-a39739dd26db,network=Network(a6fc7cf2-83ce-4137-8e63-a6316989706b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f81b5ce-2c') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f81b5ce-2c, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:53 user nova-compute[71312]: INFO os_vif [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c8:59,bridge_name='br-int',has_traffic_filtering=True,id=5f81b5ce-2c7e-4901-953e-a39739dd26db,network=Network(a6fc7cf2-83ce-4137-8e63-a6316989706b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f81b5ce-2c')
Apr 14 05:48:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Deleting instance files /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae_del
Apr 14 05:48:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Deletion of /opt/stack/data/nova/instances/4f0881a2-86a2-40e5-8c3a-1ca12da65aae_del complete
Apr 14 05:48:53 user nova-compute[71312]: INFO nova.compute.manager [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Took 1.03 seconds to destroy the instance on the hypervisor.
Apr 14 05:48:53 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 193986560 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'flavor' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.209s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "interface-b91c97cd-ba56-4cd7-845d-28e6c9f37836-c32e89f7-517b-48a5-a592-61d3685581b0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "interface-b91c97cd-ba56-4cd7-845d-28e6c9f37836-c32e89f7-517b-48a5-a592-61d3685581b0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'flavor' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converting VIF {"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Attempting to detach device tapc32e89f7-51 from instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] detach device xml: <interface type="ethernet">
Apr 14 05:48:53 user nova-compute[71312]:   <mac address="fa:16:3e:c0:4a:89"/>
Apr 14 05:48:53 user nova-compute[71312]:   <model type="virtio"/>
Apr 14 05:48:53 user nova-compute[71312]:   <mtu size="1442"/>
Apr 14 05:48:53 user nova-compute[71312]:   <target dev="tapc32e89f7-51"/>
Apr 14 05:48:53 user nova-compute[71312]: </interface>
Apr 14 05:48:53 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface>not found in domain: <domain type='kvm' id='5'>
Apr 14 05:48:53 user nova-compute[71312]:   <name>instance-00000005</name>
Apr 14 05:48:53 user nova-compute[71312]:   <uuid>b91c97cd-ba56-4cd7-845d-28e6c9f37836</uuid>
Apr 14 05:48:53 user nova-compute[71312]:   <metadata>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:48:53 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-2066307036</nova:name>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:creationTime>2023-04-14 05:48:40</nova:creationTime>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:flavor name="m1.nano">
Apr 14 05:48:53 user nova-compute[71312]:     <nova:memory>128</nova:memory>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:flavor>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:owner>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:user uuid="a1d16c8d82ea4d38b34bef8f1a9e9f92">tempest-TaggedAttachmentsTest-1560780204-project-member</nova:user>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:project uuid="5f62071417bf445d8982419fb3cfb625">tempest-TaggedAttachmentsTest-1560780204</nova:project>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:owner>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:ports>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:port uuid="b5264ebc-31b1-434f-b555-abcbebb4c6e2">
Apr 14 05:48:53 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:48:53 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:port uuid="c32e89f7-517b-48a5-a592-61d3685581b0">
Apr 14 05:48:53 user nova-compute[71312]:       <nova:ip type="fixed" address="10.10.10.68" ipVersion="4"/>
Apr 14 05:48:53 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:ports>
Apr 14 05:48:53 user nova-compute[71312]: </nova:instance>
Apr 14 05:48:53 user nova-compute[71312]:   </metadata>
Apr 14 05:48:53 user nova-compute[71312]:   <memory unit='KiB'>131072</memory>
Apr 14 05:48:53 user nova-compute[71312]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 05:48:53 user nova-compute[71312]:   <vcpu placement='static'>1</vcpu>
Apr 14 05:48:53 user nova-compute[71312]:   <resource>
Apr 14 05:48:53 user nova-compute[71312]:     <partition>/machine</partition>
Apr 14 05:48:53 user nova-compute[71312]:   </resource>
Apr 14 05:48:53 user nova-compute[71312]:   <sysinfo type='smbios'>
Apr 14 05:48:53 user nova-compute[71312]:     <system>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='version'>0.0.0</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='serial'>b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='uuid'>b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='family'>Virtual Machine</entry>
Apr 14 05:48:53 user nova-compute[71312]:     </system>
Apr 14 05:48:53 user nova-compute[71312]:   </sysinfo>
Apr 14 05:48:53 user nova-compute[71312]:   <os>
Apr 14 05:48:53 user nova-compute[71312]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 05:48:53 user nova-compute[71312]:     <boot dev='hd'/>
Apr 14 05:48:53 user nova-compute[71312]:     <smbios mode='sysinfo'/>
Apr 14 05:48:53 user nova-compute[71312]:   </os>
Apr 14 05:48:53 user nova-compute[71312]:   <features>
Apr 14 05:48:53 user nova-compute[71312]:     <acpi/>
Apr 14 05:48:53 user nova-compute[71312]:     <apic/>
Apr 14 05:48:53 user nova-compute[71312]:     <vmcoreinfo state='on'/>
Apr 14 05:48:53 user nova-compute[71312]:   </features>
Apr 14 05:48:53 user nova-compute[71312]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 05:48:53 user nova-compute[71312]:     <model fallback='forbid'>Nehalem</model>
Apr 14 05:48:53 user nova-compute[71312]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 05:48:53 user nova-compute[71312]:     <feature policy='require' name='vme'/>
Apr 14 05:48:53 user nova-compute[71312]:     <feature policy='require' name='x2apic'/>
Apr 14 05:48:53 user nova-compute[71312]:     <feature policy='require' name='hypervisor'/>
Apr 14 05:48:53 user nova-compute[71312]:   </cpu>
Apr 14 05:48:53 user nova-compute[71312]:   <clock offset='utc'>
Apr 14 05:48:53 user nova-compute[71312]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 05:48:53 user nova-compute[71312]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 05:48:53 user nova-compute[71312]:     <timer name='hpet' present='no'/>
Apr 14 05:48:53 user nova-compute[71312]:   </clock>
Apr 14 05:48:53 user nova-compute[71312]:   <on_poweroff>destroy</on_poweroff>
Apr 14 05:48:53 user nova-compute[71312]:   <on_reboot>restart</on_reboot>
Apr 14 05:48:53 user nova-compute[71312]:   <on_crash>destroy</on_crash>
Apr 14 05:48:53 user nova-compute[71312]:   <devices>
Apr 14 05:48:53 user nova-compute[71312]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 05:48:53 user nova-compute[71312]:     <disk type='file' device='disk'>
Apr 14 05:48:53 user nova-compute[71312]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 05:48:53 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk' index='2'/>
Apr 14 05:48:53 user nova-compute[71312]:       <backingStore type='file' index='3'>
Apr 14 05:48:53 user nova-compute[71312]:         <format type='raw'/>
Apr 14 05:48:53 user nova-compute[71312]:         <source file='/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620'/>
Apr 14 05:48:53 user nova-compute[71312]:         <backingStore/>
Apr 14 05:48:53 user nova-compute[71312]:       </backingStore>
Apr 14 05:48:53 user nova-compute[71312]:       <target dev='vda' bus='virtio'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='virtio-disk0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </disk>
Apr 14 05:48:53 user nova-compute[71312]:     <disk type='file' device='cdrom'>
Apr 14 05:48:53 user nova-compute[71312]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 05:48:53 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.config' index='1'/>
Apr 14 05:48:53 user nova-compute[71312]:       <backingStore/>
Apr 14 05:48:53 user nova-compute[71312]:       <target dev='hda' bus='ide'/>
Apr 14 05:48:53 user nova-compute[71312]:       <readonly/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='ide0-0-0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </disk>
Apr 14 05:48:53 user nova-compute[71312]:     <controller type='usb' index='0' model='none'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='usb'/>
Apr 14 05:48:53 user nova-compute[71312]:     </controller>
Apr 14 05:48:53 user nova-compute[71312]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='pci.0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </controller>
Apr 14 05:48:53 user nova-compute[71312]:     <controller type='ide' index='0'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='ide'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 05:48:53 user nova-compute[71312]:     </controller>
Apr 14 05:48:53 user nova-compute[71312]:     <interface type='ethernet'>
Apr 14 05:48:53 user nova-compute[71312]:       <mac address='fa:16:3e:1d:f8:9d'/>
Apr 14 05:48:53 user nova-compute[71312]:       <target dev='tapb5264ebc-31'/>
Apr 14 05:48:53 user nova-compute[71312]:       <model type='virtio'/>
Apr 14 05:48:53 user nova-compute[71312]:       <mtu size='1442'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='net0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </interface>
Apr 14 05:48:53 user nova-compute[71312]:     <interface type='ethernet'>
Apr 14 05:48:53 user nova-compute[71312]:       <mac address='fa:16:3e:c0:4a:89'/>
Apr 14 05:48:53 user nova-compute[71312]:       <target dev='tapc32e89f7-51'/>
Apr 14 05:48:53 user nova-compute[71312]:       <model type='virtio'/>
Apr 14 05:48:53 user nova-compute[71312]:       <mtu size='1442'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='net1'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </interface>
Apr 14 05:48:53 user nova-compute[71312]:     <serial type='pty'>
Apr 14 05:48:53 user nova-compute[71312]:       <source path='/dev/pts/6'/>
Apr 14 05:48:53 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log' append='off'/>
Apr 14 05:48:53 user nova-compute[71312]:       <target type='isa-serial' port='0'>
Apr 14 05:48:53 user nova-compute[71312]:         <model name='isa-serial'/>
Apr 14 05:48:53 user nova-compute[71312]:       </target>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='serial0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </serial>
Apr 14 05:48:53 user nova-compute[71312]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 05:48:53 user nova-compute[71312]:       <source path='/dev/pts/6'/>
Apr 14 05:48:53 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log' append='off'/>
Apr 14 05:48:53 user nova-compute[71312]:       <target type='serial' port='0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='serial0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </console>
Apr 14 05:48:53 user nova-compute[71312]:     <input type='mouse' bus='ps2'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='input0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </input>
Apr 14 05:48:53 user nova-compute[71312]:     <input type='keyboard' bus='ps2'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='input1'/>
Apr 14 05:48:53 user nova-compute[71312]:     </input>
Apr 14 05:48:53 user nova-compute[71312]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Apr 14 05:48:53 user nova-compute[71312]:       <listen type='address' address='0.0.0.0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </graphics>
Apr 14 05:48:53 user nova-compute[71312]:     <audio id='1' type='none'/>
Apr 14 05:48:53 user nova-compute[71312]:     <video>
Apr 14 05:48:53 user nova-compute[71312]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='video0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </video>
Apr 14 05:48:53 user nova-compute[71312]:     <memballoon model='virtio'>
Apr 14 05:48:53 user nova-compute[71312]:       <stats period='10'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='balloon0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </memballoon>
Apr 14 05:48:53 user nova-compute[71312]:     <rng model='virtio'>
Apr 14 05:48:53 user nova-compute[71312]:       <backend model='random'>/dev/urandom</backend>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='rng0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </rng>
Apr 14 05:48:53 user nova-compute[71312]:   </devices>
Apr 14 05:48:53 user nova-compute[71312]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 05:48:53 user nova-compute[71312]:     <label>libvirt-b91c97cd-ba56-4cd7-845d-28e6c9f37836</label>
Apr 14 05:48:53 user nova-compute[71312]:     <imagelabel>libvirt-b91c97cd-ba56-4cd7-845d-28e6c9f37836</imagelabel>
Apr 14 05:48:53 user nova-compute[71312]:   </seclabel>
Apr 14 05:48:53 user nova-compute[71312]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 05:48:53 user nova-compute[71312]:     <label>+64055:+108</label>
Apr 14 05:48:53 user nova-compute[71312]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 05:48:53 user nova-compute[71312]:   </seclabel>
Apr 14 05:48:53 user nova-compute[71312]: </domain>
Apr 14 05:48:53 user nova-compute[71312]:  {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 05:48:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Successfully detached device tapc32e89f7-51 from instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 from the persistent domain config.
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] (1/8): Attempting to detach device tapc32e89f7-51 with device alias net1 from instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] detach device xml: <interface type="ethernet">
Apr 14 05:48:53 user nova-compute[71312]:   <mac address="fa:16:3e:c0:4a:89"/>
Apr 14 05:48:53 user nova-compute[71312]:   <model type="virtio"/>
Apr 14 05:48:53 user nova-compute[71312]:   <mtu size="1442"/>
Apr 14 05:48:53 user nova-compute[71312]:   <target dev="tapc32e89f7-51"/>
Apr 14 05:48:53 user nova-compute[71312]: </interface>
Apr 14 05:48:53 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 235929600 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451333.8088915, b91c97cd-ba56-4cd7-845d-28e6c9f37836 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Start waiting for the detach event from libvirt for device tapc32e89f7-51 with device alias net1 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface>not found in domain: <domain type='kvm' id='5'>
Apr 14 05:48:53 user nova-compute[71312]:   <name>instance-00000005</name>
Apr 14 05:48:53 user nova-compute[71312]:   <uuid>b91c97cd-ba56-4cd7-845d-28e6c9f37836</uuid>
Apr 14 05:48:53 user nova-compute[71312]:   <metadata>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:48:53 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-2066307036</nova:name>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:creationTime>2023-04-14 05:48:40</nova:creationTime>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:flavor name="m1.nano">
Apr 14 05:48:53 user nova-compute[71312]:     <nova:memory>128</nova:memory>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:flavor>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:owner>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:user uuid="a1d16c8d82ea4d38b34bef8f1a9e9f92">tempest-TaggedAttachmentsTest-1560780204-project-member</nova:user>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:project uuid="5f62071417bf445d8982419fb3cfb625">tempest-TaggedAttachmentsTest-1560780204</nova:project>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:owner>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:ports>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:port uuid="b5264ebc-31b1-434f-b555-abcbebb4c6e2">
Apr 14 05:48:53 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:48:53 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:port uuid="c32e89f7-517b-48a5-a592-61d3685581b0">
Apr 14 05:48:53 user nova-compute[71312]:       <nova:ip type="fixed" address="10.10.10.68" ipVersion="4"/>
Apr 14 05:48:53 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:ports>
Apr 14 05:48:53 user nova-compute[71312]: </nova:instance>
Apr 14 05:48:53 user nova-compute[71312]:   </metadata>
Apr 14 05:48:53 user nova-compute[71312]:   <memory unit='KiB'>131072</memory>
Apr 14 05:48:53 user nova-compute[71312]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 05:48:53 user nova-compute[71312]:   <vcpu placement='static'>1</vcpu>
Apr 14 05:48:53 user nova-compute[71312]:   <resource>
Apr 14 05:48:53 user nova-compute[71312]:     <partition>/machine</partition>
Apr 14 05:48:53 user nova-compute[71312]:   </resource>
Apr 14 05:48:53 user nova-compute[71312]:   <sysinfo type='smbios'>
Apr 14 05:48:53 user nova-compute[71312]:     <system>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='version'>0.0.0</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='serial'>b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='uuid'>b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:48:53 user nova-compute[71312]:       <entry name='family'>Virtual Machine</entry>
Apr 14 05:48:53 user nova-compute[71312]:     </system>
Apr 14 05:48:53 user nova-compute[71312]:   </sysinfo>
Apr 14 05:48:53 user nova-compute[71312]:   <os>
Apr 14 05:48:53 user nova-compute[71312]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 05:48:53 user nova-compute[71312]:     <boot dev='hd'/>
Apr 14 05:48:53 user nova-compute[71312]:     <smbios mode='sysinfo'/>
Apr 14 05:48:53 user nova-compute[71312]:   </os>
Apr 14 05:48:53 user nova-compute[71312]:   <features>
Apr 14 05:48:53 user nova-compute[71312]:     <acpi/>
Apr 14 05:48:53 user nova-compute[71312]:     <apic/>
Apr 14 05:48:53 user nova-compute[71312]:     <vmcoreinfo state='on'/>
Apr 14 05:48:53 user nova-compute[71312]:   </features>
Apr 14 05:48:53 user nova-compute[71312]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 05:48:53 user nova-compute[71312]:     <model fallback='forbid'>Nehalem</model>
Apr 14 05:48:53 user nova-compute[71312]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 05:48:53 user nova-compute[71312]:     <feature policy='require' name='vme'/>
Apr 14 05:48:53 user nova-compute[71312]:     <feature policy='require' name='x2apic'/>
Apr 14 05:48:53 user nova-compute[71312]:     <feature policy='require' name='hypervisor'/>
Apr 14 05:48:53 user nova-compute[71312]:   </cpu>
Apr 14 05:48:53 user nova-compute[71312]:   <clock offset='utc'>
Apr 14 05:48:53 user nova-compute[71312]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 05:48:53 user nova-compute[71312]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 05:48:53 user nova-compute[71312]:     <timer name='hpet' present='no'/>
Apr 14 05:48:53 user nova-compute[71312]:   </clock>
Apr 14 05:48:53 user nova-compute[71312]:   <on_poweroff>destroy</on_poweroff>
Apr 14 05:48:53 user nova-compute[71312]:   <on_reboot>restart</on_reboot>
Apr 14 05:48:53 user nova-compute[71312]:   <on_crash>destroy</on_crash>
Apr 14 05:48:53 user nova-compute[71312]:   <devices>
Apr 14 05:48:53 user nova-compute[71312]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 05:48:53 user nova-compute[71312]:     <disk type='file' device='disk'>
Apr 14 05:48:53 user nova-compute[71312]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 05:48:53 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk' index='2'/>
Apr 14 05:48:53 user nova-compute[71312]:       <backingStore type='file' index='3'>
Apr 14 05:48:53 user nova-compute[71312]:         <format type='raw'/>
Apr 14 05:48:53 user nova-compute[71312]:         <source file='/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620'/>
Apr 14 05:48:53 user nova-compute[71312]:         <backingStore/>
Apr 14 05:48:53 user nova-compute[71312]:       </backingStore>
Apr 14 05:48:53 user nova-compute[71312]:       <target dev='vda' bus='virtio'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='virtio-disk0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </disk>
Apr 14 05:48:53 user nova-compute[71312]:     <disk type='file' device='cdrom'>
Apr 14 05:48:53 user nova-compute[71312]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 05:48:53 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.config' index='1'/>
Apr 14 05:48:53 user nova-compute[71312]:       <backingStore/>
Apr 14 05:48:53 user nova-compute[71312]:       <target dev='hda' bus='ide'/>
Apr 14 05:48:53 user nova-compute[71312]:       <readonly/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='ide0-0-0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </disk>
Apr 14 05:48:53 user nova-compute[71312]:     <controller type='usb' index='0' model='none'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='usb'/>
Apr 14 05:48:53 user nova-compute[71312]:     </controller>
Apr 14 05:48:53 user nova-compute[71312]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='pci.0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </controller>
Apr 14 05:48:53 user nova-compute[71312]:     <controller type='ide' index='0'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='ide'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 05:48:53 user nova-compute[71312]:     </controller>
Apr 14 05:48:53 user nova-compute[71312]:     <interface type='ethernet'>
Apr 14 05:48:53 user nova-compute[71312]:       <mac address='fa:16:3e:1d:f8:9d'/>
Apr 14 05:48:53 user nova-compute[71312]:       <target dev='tapb5264ebc-31'/>
Apr 14 05:48:53 user nova-compute[71312]:       <model type='virtio'/>
Apr 14 05:48:53 user nova-compute[71312]:       <mtu size='1442'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='net0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </interface>
Apr 14 05:48:53 user nova-compute[71312]:     <serial type='pty'>
Apr 14 05:48:53 user nova-compute[71312]:       <source path='/dev/pts/6'/>
Apr 14 05:48:53 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log' append='off'/>
Apr 14 05:48:53 user nova-compute[71312]:       <target type='isa-serial' port='0'>
Apr 14 05:48:53 user nova-compute[71312]:         <model name='isa-serial'/>
Apr 14 05:48:53 user nova-compute[71312]:       </target>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='serial0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </serial>
Apr 14 05:48:53 user nova-compute[71312]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 05:48:53 user nova-compute[71312]:       <source path='/dev/pts/6'/>
Apr 14 05:48:53 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log' append='off'/>
Apr 14 05:48:53 user nova-compute[71312]:       <target type='serial' port='0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='serial0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </console>
Apr 14 05:48:53 user nova-compute[71312]:     <input type='mouse' bus='ps2'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='input0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </input>
Apr 14 05:48:53 user nova-compute[71312]:     <input type='keyboard' bus='ps2'>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='input1'/>
Apr 14 05:48:53 user nova-compute[71312]:     </input>
Apr 14 05:48:53 user nova-compute[71312]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Apr 14 05:48:53 user nova-compute[71312]:       <listen type='address' address='0.0.0.0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </graphics>
Apr 14 05:48:53 user nova-compute[71312]:     <audio id='1' type='none'/>
Apr 14 05:48:53 user nova-compute[71312]:     <video>
Apr 14 05:48:53 user nova-compute[71312]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='video0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </video>
Apr 14 05:48:53 user nova-compute[71312]:     <memballoon model='virtio'>
Apr 14 05:48:53 user nova-compute[71312]:       <stats period='10'/>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='balloon0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </memballoon>
Apr 14 05:48:53 user nova-compute[71312]:     <rng model='virtio'>
Apr 14 05:48:53 user nova-compute[71312]:       <backend model='random'>/dev/urandom</backend>
Apr 14 05:48:53 user nova-compute[71312]:       <alias name='rng0'/>
Apr 14 05:48:53 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 05:48:53 user nova-compute[71312]:     </rng>
Apr 14 05:48:53 user nova-compute[71312]:   </devices>
Apr 14 05:48:53 user nova-compute[71312]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 05:48:53 user nova-compute[71312]:     <label>libvirt-b91c97cd-ba56-4cd7-845d-28e6c9f37836</label>
Apr 14 05:48:53 user nova-compute[71312]:     <imagelabel>libvirt-b91c97cd-ba56-4cd7-845d-28e6c9f37836</imagelabel>
Apr 14 05:48:53 user nova-compute[71312]:   </seclabel>
Apr 14 05:48:53 user nova-compute[71312]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 05:48:53 user nova-compute[71312]:     <label>+64055:+108</label>
Apr 14 05:48:53 user nova-compute[71312]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 05:48:53 user nova-compute[71312]:   </seclabel>
Apr 14 05:48:53 user nova-compute[71312]: </domain>
Apr 14 05:48:53 user nova-compute[71312]:  {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 05:48:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Successfully detached device tapc32e89f7-51 from instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 from the live domain config.
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converting VIF {"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG os_vif [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc32e89f7-51, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:48:53 user nova-compute[71312]: INFO os_vif [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51')
Apr 14 05:48:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:48:53 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-2066307036</nova:name>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:creationTime>2023-04-14 05:48:53</nova:creationTime>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:flavor name="m1.nano">
Apr 14 05:48:53 user nova-compute[71312]:     <nova:memory>128</nova:memory>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:flavor>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:owner>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:user uuid="a1d16c8d82ea4d38b34bef8f1a9e9f92">tempest-TaggedAttachmentsTest-1560780204-project-member</nova:user>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:project uuid="5f62071417bf445d8982419fb3cfb625">tempest-TaggedAttachmentsTest-1560780204</nova:project>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:owner>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:48:53 user nova-compute[71312]:   <nova:ports>
Apr 14 05:48:53 user nova-compute[71312]:     <nova:port uuid="b5264ebc-31b1-434f-b555-abcbebb4c6e2">
Apr 14 05:48:53 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:48:53 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:53 user nova-compute[71312]:   </nova:ports>
Apr 14 05:48:53 user nova-compute[71312]: </nova:instance>
Apr 14 05:48:53 user nova-compute[71312]:  {{(pid=71312) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 418381824 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received event network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Acquiring lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] No waiting events found dispatching network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:54 user nova-compute[71312]: WARNING nova.compute.manager [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received unexpected event network-vif-plugged-5f81b5ce-2c7e-4901-953e-a39739dd26db for instance with vm_state active and task_state deleting.
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-unplugged-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] No waiting events found dispatching network-vif-unplugged-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:54 user nova-compute[71312]: WARNING nova.compute.manager [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received unexpected event network-vif-unplugged-c32e89f7-517b-48a5-a592-61d3685581b0 for instance with vm_state active and task_state None.
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 563085312 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-deleted-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:54 user nova-compute[71312]: INFO nova.compute.manager [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Neutron deleted interface c32e89f7-517b-48a5-a592-61d3685581b0; detaching it from the instance and deleting it from the info cache
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.network.neutron [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating instance_info_cache with network_info: [{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.objects.instance [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Lazy-loading 'system_metadata' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquired lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.objects.instance [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Lazy-loading 'flavor' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:48:54 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Took 1.77 seconds to deallocate network for instance.
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Converting VIF {"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface>not found in domain: <domain type='kvm' id='5'>
Apr 14 05:48:54 user nova-compute[71312]:   <name>instance-00000005</name>
Apr 14 05:48:54 user nova-compute[71312]:   <uuid>b91c97cd-ba56-4cd7-845d-28e6c9f37836</uuid>
Apr 14 05:48:54 user nova-compute[71312]:   <metadata>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:48:54 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-2066307036</nova:name>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:creationTime>2023-04-14 05:48:53</nova:creationTime>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:flavor name="m1.nano">
Apr 14 05:48:54 user nova-compute[71312]:     <nova:memory>128</nova:memory>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Apr 14 05:48:54 user nova-compute[71312]:   </nova:flavor>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:owner>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:user uuid="a1d16c8d82ea4d38b34bef8f1a9e9f92">tempest-TaggedAttachmentsTest-1560780204-project-member</nova:user>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:project uuid="5f62071417bf445d8982419fb3cfb625">tempest-TaggedAttachmentsTest-1560780204</nova:project>
Apr 14 05:48:54 user nova-compute[71312]:   </nova:owner>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:ports>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:port uuid="b5264ebc-31b1-434f-b555-abcbebb4c6e2">
Apr 14 05:48:54 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:48:54 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:54 user nova-compute[71312]:   </nova:ports>
Apr 14 05:48:54 user nova-compute[71312]: </nova:instance>
Apr 14 05:48:54 user nova-compute[71312]:   </metadata>
Apr 14 05:48:54 user nova-compute[71312]:   <memory unit='KiB'>131072</memory>
Apr 14 05:48:54 user nova-compute[71312]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 05:48:54 user nova-compute[71312]:   <vcpu placement='static'>1</vcpu>
Apr 14 05:48:54 user nova-compute[71312]:   <resource>
Apr 14 05:48:54 user nova-compute[71312]:     <partition>/machine</partition>
Apr 14 05:48:54 user nova-compute[71312]:   </resource>
Apr 14 05:48:54 user nova-compute[71312]:   <sysinfo type='smbios'>
Apr 14 05:48:54 user nova-compute[71312]:     <system>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='version'>0.0.0</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='serial'>b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='uuid'>b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='family'>Virtual Machine</entry>
Apr 14 05:48:54 user nova-compute[71312]:     </system>
Apr 14 05:48:54 user nova-compute[71312]:   </sysinfo>
Apr 14 05:48:54 user nova-compute[71312]:   <os>
Apr 14 05:48:54 user nova-compute[71312]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 05:48:54 user nova-compute[71312]:     <boot dev='hd'/>
Apr 14 05:48:54 user nova-compute[71312]:     <smbios mode='sysinfo'/>
Apr 14 05:48:54 user nova-compute[71312]:   </os>
Apr 14 05:48:54 user nova-compute[71312]:   <features>
Apr 14 05:48:54 user nova-compute[71312]:     <acpi/>
Apr 14 05:48:54 user nova-compute[71312]:     <apic/>
Apr 14 05:48:54 user nova-compute[71312]:     <vmcoreinfo state='on'/>
Apr 14 05:48:54 user nova-compute[71312]:   </features>
Apr 14 05:48:54 user nova-compute[71312]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 05:48:54 user nova-compute[71312]:     <model fallback='forbid'>Nehalem</model>
Apr 14 05:48:54 user nova-compute[71312]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 05:48:54 user nova-compute[71312]:     <feature policy='require' name='vme'/>
Apr 14 05:48:54 user nova-compute[71312]:     <feature policy='require' name='x2apic'/>
Apr 14 05:48:54 user nova-compute[71312]:     <feature policy='require' name='hypervisor'/>
Apr 14 05:48:54 user nova-compute[71312]:   </cpu>
Apr 14 05:48:54 user nova-compute[71312]:   <clock offset='utc'>
Apr 14 05:48:54 user nova-compute[71312]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 05:48:54 user nova-compute[71312]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 05:48:54 user nova-compute[71312]:     <timer name='hpet' present='no'/>
Apr 14 05:48:54 user nova-compute[71312]:   </clock>
Apr 14 05:48:54 user nova-compute[71312]:   <on_poweroff>destroy</on_poweroff>
Apr 14 05:48:54 user nova-compute[71312]:   <on_reboot>restart</on_reboot>
Apr 14 05:48:54 user nova-compute[71312]:   <on_crash>destroy</on_crash>
Apr 14 05:48:54 user nova-compute[71312]:   <devices>
Apr 14 05:48:54 user nova-compute[71312]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 05:48:54 user nova-compute[71312]:     <disk type='file' device='disk'>
Apr 14 05:48:54 user nova-compute[71312]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 05:48:54 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk' index='2'/>
Apr 14 05:48:54 user nova-compute[71312]:       <backingStore type='file' index='3'>
Apr 14 05:48:54 user nova-compute[71312]:         <format type='raw'/>
Apr 14 05:48:54 user nova-compute[71312]:         <source file='/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620'/>
Apr 14 05:48:54 user nova-compute[71312]:         <backingStore/>
Apr 14 05:48:54 user nova-compute[71312]:       </backingStore>
Apr 14 05:48:54 user nova-compute[71312]:       <target dev='vda' bus='virtio'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='virtio-disk0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </disk>
Apr 14 05:48:54 user nova-compute[71312]:     <disk type='file' device='cdrom'>
Apr 14 05:48:54 user nova-compute[71312]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 05:48:54 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.config' index='1'/>
Apr 14 05:48:54 user nova-compute[71312]:       <backingStore/>
Apr 14 05:48:54 user nova-compute[71312]:       <target dev='hda' bus='ide'/>
Apr 14 05:48:54 user nova-compute[71312]:       <readonly/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='ide0-0-0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </disk>
Apr 14 05:48:54 user nova-compute[71312]:     <controller type='usb' index='0' model='none'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='usb'/>
Apr 14 05:48:54 user nova-compute[71312]:     </controller>
Apr 14 05:48:54 user nova-compute[71312]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='pci.0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </controller>
Apr 14 05:48:54 user nova-compute[71312]:     <controller type='ide' index='0'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='ide'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 05:48:54 user nova-compute[71312]:     </controller>
Apr 14 05:48:54 user nova-compute[71312]:     <interface type='ethernet'>
Apr 14 05:48:54 user nova-compute[71312]:       <mac address='fa:16:3e:1d:f8:9d'/>
Apr 14 05:48:54 user nova-compute[71312]:       <target dev='tapb5264ebc-31'/>
Apr 14 05:48:54 user nova-compute[71312]:       <model type='virtio'/>
Apr 14 05:48:54 user nova-compute[71312]:       <mtu size='1442'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='net0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </interface>
Apr 14 05:48:54 user nova-compute[71312]:     <serial type='pty'>
Apr 14 05:48:54 user nova-compute[71312]:       <source path='/dev/pts/6'/>
Apr 14 05:48:54 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log' append='off'/>
Apr 14 05:48:54 user nova-compute[71312]:       <target type='isa-serial' port='0'>
Apr 14 05:48:54 user nova-compute[71312]:         <model name='isa-serial'/>
Apr 14 05:48:54 user nova-compute[71312]:       </target>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='serial0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </serial>
Apr 14 05:48:54 user nova-compute[71312]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 05:48:54 user nova-compute[71312]:       <source path='/dev/pts/6'/>
Apr 14 05:48:54 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log' append='off'/>
Apr 14 05:48:54 user nova-compute[71312]:       <target type='serial' port='0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='serial0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </console>
Apr 14 05:48:54 user nova-compute[71312]:     <input type='mouse' bus='ps2'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='input0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </input>
Apr 14 05:48:54 user nova-compute[71312]:     <input type='keyboard' bus='ps2'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='input1'/>
Apr 14 05:48:54 user nova-compute[71312]:     </input>
Apr 14 05:48:54 user nova-compute[71312]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Apr 14 05:48:54 user nova-compute[71312]:       <listen type='address' address='0.0.0.0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </graphics>
Apr 14 05:48:54 user nova-compute[71312]:     <audio id='1' type='none'/>
Apr 14 05:48:54 user nova-compute[71312]:     <video>
Apr 14 05:48:54 user nova-compute[71312]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='video0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </video>
Apr 14 05:48:54 user nova-compute[71312]:     <memballoon model='virtio'>
Apr 14 05:48:54 user nova-compute[71312]:       <stats period='10'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='balloon0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </memballoon>
Apr 14 05:48:54 user nova-compute[71312]:     <rng model='virtio'>
Apr 14 05:48:54 user nova-compute[71312]:       <backend model='random'>/dev/urandom</backend>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='rng0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </rng>
Apr 14 05:48:54 user nova-compute[71312]:   </devices>
Apr 14 05:48:54 user nova-compute[71312]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 05:48:54 user nova-compute[71312]:     <label>libvirt-b91c97cd-ba56-4cd7-845d-28e6c9f37836</label>
Apr 14 05:48:54 user nova-compute[71312]:     <imagelabel>libvirt-b91c97cd-ba56-4cd7-845d-28e6c9f37836</imagelabel>
Apr 14 05:48:54 user nova-compute[71312]:   </seclabel>
Apr 14 05:48:54 user nova-compute[71312]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 05:48:54 user nova-compute[71312]:     <label>+64055:+108</label>
Apr 14 05:48:54 user nova-compute[71312]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 05:48:54 user nova-compute[71312]:   </seclabel>
Apr 14 05:48:54 user nova-compute[71312]: </domain>
Apr 14 05:48:54 user nova-compute[71312]:  {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface> {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c0:4a:89"/><model type="virtio"/><mtu size="1442"/><target dev="tapc32e89f7-51"/></interface>not found in domain: <domain type='kvm' id='5'>
Apr 14 05:48:54 user nova-compute[71312]:   <name>instance-00000005</name>
Apr 14 05:48:54 user nova-compute[71312]:   <uuid>b91c97cd-ba56-4cd7-845d-28e6c9f37836</uuid>
Apr 14 05:48:54 user nova-compute[71312]:   <metadata>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:48:54 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-2066307036</nova:name>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:creationTime>2023-04-14 05:48:53</nova:creationTime>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:flavor name="m1.nano">
Apr 14 05:48:54 user nova-compute[71312]:     <nova:memory>128</nova:memory>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Apr 14 05:48:54 user nova-compute[71312]:   </nova:flavor>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:owner>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:user uuid="a1d16c8d82ea4d38b34bef8f1a9e9f92">tempest-TaggedAttachmentsTest-1560780204-project-member</nova:user>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:project uuid="5f62071417bf445d8982419fb3cfb625">tempest-TaggedAttachmentsTest-1560780204</nova:project>
Apr 14 05:48:54 user nova-compute[71312]:   </nova:owner>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:48:54 user nova-compute[71312]:   <nova:ports>
Apr 14 05:48:54 user nova-compute[71312]:     <nova:port uuid="b5264ebc-31b1-434f-b555-abcbebb4c6e2">
Apr 14 05:48:54 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:48:54 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:54 user nova-compute[71312]:   </nova:ports>
Apr 14 05:48:54 user nova-compute[71312]: </nova:instance>
Apr 14 05:48:54 user nova-compute[71312]:   </metadata>
Apr 14 05:48:54 user nova-compute[71312]:   <memory unit='KiB'>131072</memory>
Apr 14 05:48:54 user nova-compute[71312]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 05:48:54 user nova-compute[71312]:   <vcpu placement='static'>1</vcpu>
Apr 14 05:48:54 user nova-compute[71312]:   <resource>
Apr 14 05:48:54 user nova-compute[71312]:     <partition>/machine</partition>
Apr 14 05:48:54 user nova-compute[71312]:   </resource>
Apr 14 05:48:54 user nova-compute[71312]:   <sysinfo type='smbios'>
Apr 14 05:48:54 user nova-compute[71312]:     <system>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='version'>0.0.0</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='serial'>b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='uuid'>b91c97cd-ba56-4cd7-845d-28e6c9f37836</entry>
Apr 14 05:48:54 user nova-compute[71312]:       <entry name='family'>Virtual Machine</entry>
Apr 14 05:48:54 user nova-compute[71312]:     </system>
Apr 14 05:48:54 user nova-compute[71312]:   </sysinfo>
Apr 14 05:48:54 user nova-compute[71312]:   <os>
Apr 14 05:48:54 user nova-compute[71312]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 05:48:54 user nova-compute[71312]:     <boot dev='hd'/>
Apr 14 05:48:54 user nova-compute[71312]:     <smbios mode='sysinfo'/>
Apr 14 05:48:54 user nova-compute[71312]:   </os>
Apr 14 05:48:54 user nova-compute[71312]:   <features>
Apr 14 05:48:54 user nova-compute[71312]:     <acpi/>
Apr 14 05:48:54 user nova-compute[71312]:     <apic/>
Apr 14 05:48:54 user nova-compute[71312]:     <vmcoreinfo state='on'/>
Apr 14 05:48:54 user nova-compute[71312]:   </features>
Apr 14 05:48:54 user nova-compute[71312]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 05:48:54 user nova-compute[71312]:     <model fallback='forbid'>Nehalem</model>
Apr 14 05:48:54 user nova-compute[71312]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 05:48:54 user nova-compute[71312]:     <feature policy='require' name='vme'/>
Apr 14 05:48:54 user nova-compute[71312]:     <feature policy='require' name='x2apic'/>
Apr 14 05:48:54 user nova-compute[71312]:     <feature policy='require' name='hypervisor'/>
Apr 14 05:48:54 user nova-compute[71312]:   </cpu>
Apr 14 05:48:54 user nova-compute[71312]:   <clock offset='utc'>
Apr 14 05:48:54 user nova-compute[71312]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 05:48:54 user nova-compute[71312]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 05:48:54 user nova-compute[71312]:     <timer name='hpet' present='no'/>
Apr 14 05:48:54 user nova-compute[71312]:   </clock>
Apr 14 05:48:54 user nova-compute[71312]:   <on_poweroff>destroy</on_poweroff>
Apr 14 05:48:54 user nova-compute[71312]:   <on_reboot>restart</on_reboot>
Apr 14 05:48:54 user nova-compute[71312]:   <on_crash>destroy</on_crash>
Apr 14 05:48:54 user nova-compute[71312]:   <devices>
Apr 14 05:48:54 user nova-compute[71312]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 05:48:54 user nova-compute[71312]:     <disk type='file' device='disk'>
Apr 14 05:48:54 user nova-compute[71312]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 05:48:54 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk' index='2'/>
Apr 14 05:48:54 user nova-compute[71312]:       <backingStore type='file' index='3'>
Apr 14 05:48:54 user nova-compute[71312]:         <format type='raw'/>
Apr 14 05:48:54 user nova-compute[71312]:         <source file='/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620'/>
Apr 14 05:48:54 user nova-compute[71312]:         <backingStore/>
Apr 14 05:48:54 user nova-compute[71312]:       </backingStore>
Apr 14 05:48:54 user nova-compute[71312]:       <target dev='vda' bus='virtio'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='virtio-disk0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </disk>
Apr 14 05:48:54 user nova-compute[71312]:     <disk type='file' device='cdrom'>
Apr 14 05:48:54 user nova-compute[71312]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 05:48:54 user nova-compute[71312]:       <source file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk.config' index='1'/>
Apr 14 05:48:54 user nova-compute[71312]:       <backingStore/>
Apr 14 05:48:54 user nova-compute[71312]:       <target dev='hda' bus='ide'/>
Apr 14 05:48:54 user nova-compute[71312]:       <readonly/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='ide0-0-0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </disk>
Apr 14 05:48:54 user nova-compute[71312]:     <controller type='usb' index='0' model='none'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='usb'/>
Apr 14 05:48:54 user nova-compute[71312]:     </controller>
Apr 14 05:48:54 user nova-compute[71312]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='pci.0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </controller>
Apr 14 05:48:54 user nova-compute[71312]:     <controller type='ide' index='0'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='ide'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 05:48:54 user nova-compute[71312]:     </controller>
Apr 14 05:48:54 user nova-compute[71312]:     <interface type='ethernet'>
Apr 14 05:48:54 user nova-compute[71312]:       <mac address='fa:16:3e:1d:f8:9d'/>
Apr 14 05:48:54 user nova-compute[71312]:       <target dev='tapb5264ebc-31'/>
Apr 14 05:48:54 user nova-compute[71312]:       <model type='virtio'/>
Apr 14 05:48:54 user nova-compute[71312]:       <mtu size='1442'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='net0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </interface>
Apr 14 05:48:54 user nova-compute[71312]:     <serial type='pty'>
Apr 14 05:48:54 user nova-compute[71312]:       <source path='/dev/pts/6'/>
Apr 14 05:48:54 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log' append='off'/>
Apr 14 05:48:54 user nova-compute[71312]:       <target type='isa-serial' port='0'>
Apr 14 05:48:54 user nova-compute[71312]:         <model name='isa-serial'/>
Apr 14 05:48:54 user nova-compute[71312]:       </target>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='serial0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </serial>
Apr 14 05:48:54 user nova-compute[71312]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 05:48:54 user nova-compute[71312]:       <source path='/dev/pts/6'/>
Apr 14 05:48:54 user nova-compute[71312]:       <log file='/opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/console.log' append='off'/>
Apr 14 05:48:54 user nova-compute[71312]:       <target type='serial' port='0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='serial0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </console>
Apr 14 05:48:54 user nova-compute[71312]:     <input type='mouse' bus='ps2'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='input0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </input>
Apr 14 05:48:54 user nova-compute[71312]:     <input type='keyboard' bus='ps2'>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='input1'/>
Apr 14 05:48:54 user nova-compute[71312]:     </input>
Apr 14 05:48:54 user nova-compute[71312]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Apr 14 05:48:54 user nova-compute[71312]:       <listen type='address' address='0.0.0.0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </graphics>
Apr 14 05:48:54 user nova-compute[71312]:     <audio id='1' type='none'/>
Apr 14 05:48:54 user nova-compute[71312]:     <video>
Apr 14 05:48:54 user nova-compute[71312]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='video0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </video>
Apr 14 05:48:54 user nova-compute[71312]:     <memballoon model='virtio'>
Apr 14 05:48:54 user nova-compute[71312]:       <stats period='10'/>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='balloon0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </memballoon>
Apr 14 05:48:54 user nova-compute[71312]:     <rng model='virtio'>
Apr 14 05:48:54 user nova-compute[71312]:       <backend model='random'>/dev/urandom</backend>
Apr 14 05:48:54 user nova-compute[71312]:       <alias name='rng0'/>
Apr 14 05:48:54 user nova-compute[71312]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 05:48:54 user nova-compute[71312]:     </rng>
Apr 14 05:48:54 user nova-compute[71312]:   </devices>
Apr 14 05:48:54 user nova-compute[71312]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 05:48:54 user nova-compute[71312]:     <label>libvirt-b91c97cd-ba56-4cd7-845d-28e6c9f37836</label>
Apr 14 05:48:54 user nova-compute[71312]:     <imagelabel>libvirt-b91c97cd-ba56-4cd7-845d-28e6c9f37836</imagelabel>
Apr 14 05:48:54 user nova-compute[71312]:   </seclabel>
Apr 14 05:48:54 user nova-compute[71312]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 05:48:54 user nova-compute[71312]:     <label>+64055:+108</label>
Apr 14 05:48:54 user nova-compute[71312]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 05:48:54 user nova-compute[71312]:   </seclabel>
Apr 14 05:48:54 user nova-compute[71312]: </domain>
Apr 14 05:48:54 user nova-compute[71312]:  {{(pid=71312) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 05:48:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Detaching interface fa:16:3e:c0:4a:89 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapc32e89f7-51' not found.
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:48:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Converting VIF {"id": "c32e89f7-517b-48a5-a592-61d3685581b0", "address": "fa:16:3e:c0:4a:89", "network": {"id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2123171996", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32e89f7-51", "ovs_interfaceid": "c32e89f7-517b-48a5-a592-61d3685581b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG os_vif [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc32e89f7-51, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:48:55 user nova-compute[71312]: INFO os_vif [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4a:89,bridge_name='br-int',has_traffic_filtering=True,id=c32e89f7-517b-48a5-a592-61d3685581b0,network=Network(b9689044-f32a-429b-94fa-ad9b10cf6c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32e89f7-51')
Apr 14 05:48:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:48:55 user nova-compute[71312]:   <nova:package version="0.0.0"/>
Apr 14 05:48:55 user nova-compute[71312]:   <nova:name>tempest-device-tagging-server-2066307036</nova:name>
Apr 14 05:48:55 user nova-compute[71312]:   <nova:creationTime>2023-04-14 05:48:54</nova:creationTime>
Apr 14 05:48:55 user nova-compute[71312]:   <nova:flavor name="m1.nano">
Apr 14 05:48:55 user nova-compute[71312]:     <nova:memory>128</nova:memory>
Apr 14 05:48:55 user nova-compute[71312]:     <nova:disk>1</nova:disk>
Apr 14 05:48:55 user nova-compute[71312]:     <nova:swap>0</nova:swap>
Apr 14 05:48:55 user nova-compute[71312]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:48:55 user nova-compute[71312]:     <nova:vcpus>1</nova:vcpus>
Apr 14 05:48:55 user nova-compute[71312]:   </nova:flavor>
Apr 14 05:48:55 user nova-compute[71312]:   <nova:owner>
Apr 14 05:48:55 user nova-compute[71312]:     <nova:user uuid="a1d16c8d82ea4d38b34bef8f1a9e9f92">tempest-TaggedAttachmentsTest-1560780204-project-member</nova:user>
Apr 14 05:48:55 user nova-compute[71312]:     <nova:project uuid="5f62071417bf445d8982419fb3cfb625">tempest-TaggedAttachmentsTest-1560780204</nova:project>
Apr 14 05:48:55 user nova-compute[71312]:   </nova:owner>
Apr 14 05:48:55 user nova-compute[71312]:   <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:48:55 user nova-compute[71312]:   <nova:ports>
Apr 14 05:48:55 user nova-compute[71312]:     <nova:port uuid="b5264ebc-31b1-434f-b555-abcbebb4c6e2">
Apr 14 05:48:55 user nova-compute[71312]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:48:55 user nova-compute[71312]:     </nova:port>
Apr 14 05:48:55 user nova-compute[71312]:   </nova:ports>
Apr 14 05:48:55 user nova-compute[71312]: </nova:instance>
Apr 14 05:48:55 user nova-compute[71312]:  {{(pid=71312) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 740294656 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating instance_info_cache with network_info: [{"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:48:55 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Deleted allocations for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae
Apr 14 05:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Releasing lock "refresh_cache-b91c97cd-ba56-4cd7-845d-28e6c9f37836" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "interface-b91c97cd-ba56-4cd7-845d-28e6c9f37836-c32e89f7-517b-48a5-a592-61d3685581b0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.023s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "4f0881a2-86a2-40e5-8c3a-1ca12da65aae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.497s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 915406848 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:56 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[730bfec2-bae2-4dd3-9153-4dd31764e580]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:48:56 user nova-compute[71312]: No targets found.
Apr 14 05:48:56 user nova-compute[71312]: iSNS:
Apr 14 05:48:56 user nova-compute[71312]: No targets found.
Apr 14 05:48:56 user nova-compute[71312]: STATIC:
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66
Apr 14 05:48:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:48:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:48:56 user nova-compute[71312]: FIRMWARE:
Apr 14 05:48:56 user nova-compute[71312]: No targets found.
Apr 14 05:48:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:48:56 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:48:56 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f388e5fa-e278-45d0-abfa-0b82abfd3fcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c981d9c4-45c4-48f7-b3e8-57d10a8add2d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:48:56 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:48:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4100790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d'): ({'sdi'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Removing single pathed devices sdi {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411cc27-54b6-41fe-b4ab-14f4a343e5cf]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b98ae0-4ce0-4430-8974-bba56d3c6d9d]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Flushing IO for device /dev/sdi {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc25a6f7-f4b3-4b46-a54a-f901b8f09d15]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] No waiting events found dispatching network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:48:56 user nova-compute[71312]: WARNING nova.compute.manager [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received unexpected event network-vif-plugged-c32e89f7-517b-48a5-a592-61d3685581b0 for instance with vm_state active and task_state None.
Apr 14 05:48:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Received event network-vif-deleted-5f81b5ce-2c7e-4901-953e-a39739dd26db {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a8482-505a-44aa-b640-0b76b86244a3]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] SCSI volumes sdi have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca62227-2879-408f-b42f-efd6aafc36a4]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e95ada-608f-4797-9c24-00940677f428]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260]
Apr 14 05:48:56 user nova-compute[71312]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260] successful.
Apr 14 05:48:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bfe289-5748-499d-9352-4422a222dc9d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] <== disconnect_volume: return (327ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLcvJQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'a7fd3290-73e1-438e-9301-4a668e50c3be', 'attached_at': '', 'detached_at': '', 'volume_id': '8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'serial'} {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 05:48:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] swap_volume: removing Cinder connection for volume 5d5e24bd-9225-4eb3-8359-d4c380c66e0d {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 05:48:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] swap_volume: Updating volume 5d5e24bd-9225-4eb3-8359-d4c380c66e0d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "aVLcvJQf", "auth_password": "9bfoXhTnGjNEVM", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "8c38aa08-6830-4cc2-a66f-76daa76f9c10"}, "status": "reserved", "instance": "a7fd3290-73e1-438e-9301-4a668e50c3be", "attached_at": "", "detached_at": "", "volume_id": "8c38aa08-6830-4cc2-a66f-76daa76f9c10", "serial": "8c38aa08-6830-4cc2-a66f-76daa76f9c10"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'no_device': None, 'attachment_id': '6166f22e-62cc-4980-b94b-ae802b906755'} {{(pid=71312) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 05:48:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.159s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451323.658774, 1dc51328-8af2-4ddf-88e1-40cbba7a2823 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:48:58 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] VM Stopped (Lifecycle Event)
Apr 14 05:48:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-452b4fde-dcc6-4d95-a242-c4e778ce12ab None None] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG os_brick.utils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9dfb08-0ed4-4587-bd28-194edb527982]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e597dca8-20c3-48d4-bcfd-499ea1ac0e64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9fcf1c-8625-4159-9c4d-30033aba2855]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acf3769-d875-45b8-b559-f90272b72b52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:48:58 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:48:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[69367c09-99c2-4d5e-816f-41058d0abf90]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:48:58 user nova-compute[71312]: DEBUG os_brick.utils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:48:59 user nova-compute[71312]: INFO nova.compute.manager [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Swapping volume 8c38aa08-6830-4cc2-a66f-76daa76f9c10 for 5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:49:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:49:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:49:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7fd3290-73e1-438e-9301-4a668e50c3be', 'attached_at': '', 'detached_at': '', 'volume_id': '5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'serial': '5d5e24bd-9225-4eb3-8359-d4c380c66e0d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLcvJQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '8c38aa08-6830-4cc2-a66f-76daa76f9c10'}, 'status': 'reserved', 'instance': 'a7fd3290-73e1-438e-9301-4a668e50c3be', 'attached_at': '', 'detached_at': '', 'volume_id': '8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'serial'} {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:03 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b663fb88-a145-4b1d-b218-d794a582fe67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:49:03 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2215655-6f76-4f1f-bb4e-d6e73a8b4208]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d] added
Apr 14 05:49:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eb583d-2ff4-436c-9ff9-023d0907c267]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda81e89-5af7-4a3c-aebb-47283a112934]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvQHLcGM {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvQHLcGM" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f45896-cab5-4a4b-bfa3-584830edc42c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NvQHLcGM'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b257da1-229c-4361-b2a5-559c3f5fdfd7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-changed-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing instance network info cache due to event network-changed-9411547c-6ef0-4706-b74c-cf4f2d3e59a9. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] Acquiring lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] Acquired lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Refreshing network info cache for port 9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[523515bd-1620-45cd-a05e-6ceb6d872df8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5413ec4f-31bd-40e4-b819-02859cc0a4bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260]
Apr 14 05:49:03 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b5483-0501-4b36-babd-ae4d92651ad6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a583b7-55d8-457f-8306-b7914de1f8f9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:03 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] HCTL ('40', '-', '-', 0) found on session 15 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5427ea-6073-4aa0-8e63-6a331342adb7]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Searching for a device in session 15 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:49:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:49:04 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:49:04 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7867MB free_disk=26.539676666259766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance a7fd3290-73e1-438e-9301-4a668e50c3be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 72d95729-7692-4774-b0fe-5747f558d7d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 921a3289-c406-4305-8e9b-8d218461c75c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5e607038-6c40-417e-8c4f-f73f691e8672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.network.neutron [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updated VIF entry in instance network info cache for port 9411547c-6ef0-4706-b74c-cf4f2d3e59a9. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.network.neutron [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [{"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] Releasing lock "refresh_cache-72d95729-7692-4774-b0fe-5747f558d7d6" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.513s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '23431393136363933', 'path': '/dev/sdi'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431393136363933', 'path': '/dev/sdi'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lazy-loading 'flavor' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:49:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "72d95729-7692-4774-b0fe-5747f558d7d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:05 user nova-compute[71312]: INFO nova.compute.manager [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Terminating instance
Apr 14 05:49:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 132120576 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:49:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-unplugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-unplugged-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-6a5445f4-3781-433f-821c-d24cceffd920 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 462422016 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 631242752 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Instance destroyed successfully.
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lazy-loading 'resources' on Instance uuid 72d95729-7692-4774-b0fe-5747f558d7d6 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:b5,bridge_name='br-int',has_traffic_filtering=True,id=9411547c-6ef0-4706-b74c-cf4f2d3e59a9,network=Network(b076dc22-7038-47cc-9fc1-285afb5578cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9411547c-6e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:b5,bridge_name='br-int',has_traffic_filtering=True,id=9411547c-6ef0-4706-b74c-cf4f2d3e59a9,network=Network(b076dc22-7038-47cc-9fc1-285afb5578cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9411547c-6e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9411547c-6e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: INFO os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a1:b5,bridge_name='br-int',has_traffic_filtering=True,id=9411547c-6ef0-4706-b74c-cf4f2d3e59a9,network=Network(b076dc22-7038-47cc-9fc1-285afb5578cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9411547c-6e')
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3c:09,bridge_name='br-int',has_traffic_filtering=True,id=517e0448-275c-437e-9b1b-e81c27f404b4,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap517e0448-27') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3c:09,bridge_name='br-int',has_traffic_filtering=True,id=517e0448-275c-437e-9b1b-e81c27f404b4,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap517e0448-27') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap517e0448-27, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: INFO os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3c:09,bridge_name='br-int',has_traffic_filtering=True,id=517e0448-275c-437e-9b1b-e81c27f404b4,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap517e0448-27')
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1c:0f,bridge_name='br-int',has_traffic_filtering=True,id=26e5a8e2-6c30-42f8-b5a5-1c3a48515231,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e5a8e2-6c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1c:0f,bridge_name='br-int',has_traffic_filtering=True,id=26e5a8e2-6c30-42f8-b5a5-1c3a48515231,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e5a8e2-6c') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26e5a8e2-6c, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: INFO os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1c:0f,bridge_name='br-int',has_traffic_filtering=True,id=26e5a8e2-6c30-42f8-b5a5-1c3a48515231,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e5a8e2-6c')
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5445f4-3781-433f-821c-d24cceffd920,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5445f4-37') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5445f4-3781-433f-821c-d24cceffd920,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5445f4-37') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 787480576 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a5445f4-37, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:07 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451332.9789696, 4f0881a2-86a2-40e5-8c3a-1ca12da65aae => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:49:07 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] VM Stopped (Lifecycle Event)
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: INFO os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5445f4-3781-433f-821c-d24cceffd920,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5445f4-37')
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:5f:42,bridge_name='br-int',has_traffic_filtering=True,id=e8d96b7d-3503-458c-a3d6-614617cf0a6e,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d96b7d-35') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:5f:42,bridge_name='br-int',has_traffic_filtering=True,id=e8d96b7d-3503-458c-a3d6-614617cf0a6e,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d96b7d-35') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8d96b7d-35, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updating instance_info_cache with network_info: [{"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: INFO os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:5f:42,bridge_name='br-int',has_traffic_filtering=True,id=e8d96b7d-3503-458c-a3d6-614617cf0a6e,network=Network(9d6092be-0b36-4852-97f7-8fc43c108ba6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8d96b7d-35')
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "address": "fa:16:3e:87:59:ed", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28d3b9e-1e", "ovs_interfaceid": "b28d3b9e-1e32-47c0-9117-75dd980cf186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:59:ed,bridge_name='br-int',has_traffic_filtering=True,id=b28d3b9e-1e32-47c0-9117-75dd980cf186,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28d3b9e-1e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:59:ed,bridge_name='br-int',has_traffic_filtering=True,id=b28d3b9e-1e32-47c0-9117-75dd980cf186,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28d3b9e-1e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-50da9334-102b-4a76-aee7-9d1af94ba3a8 None None] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb28d3b9e-1e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:49:08 user nova-compute[71312]: INFO os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:59:ed,bridge_name='br-int',has_traffic_filtering=True,id=b28d3b9e-1e32-47c0-9117-75dd980cf186,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28d3b9e-1e')
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-408811920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-408811920',id=8,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g==',key_name='tempest-keypair-980831644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2a45bad5274464a0b89b9e275e515e',ramdisk_id='',reservation_id='r-mk0dgflr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-735316383',owner_user_name='tempest-TaggedBootDevicesTest_v242-735316383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='837f8d05577c40488c01fb21472b8870',uuid=72d95729-7692-4774-b0fe-5747f558d7d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converting VIF {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:09:e4,bridge_name='br-int',has_traffic_filtering=True,id=a161f793-130d-4fcf-8f39-163ca065ebbb,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa161f793-13') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:09:e4,bridge_name='br-int',has_traffic_filtering=True,id=a161f793-130d-4fcf-8f39-163ca065ebbb,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa161f793-13') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa161f793-13, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:08 user nova-compute[71312]: INFO os_vif [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:09:e4,bridge_name='br-int',has_traffic_filtering=True,id=a161f793-130d-4fcf-8f39-163ca065ebbb,network=Network(6b529ca6-1438-4bad-a5ca-92070f391324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa161f793-13')
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEnlgmix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:08 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce587fb8-b926-45fb-992d-5ca9919f53d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:08 user nova-compute[71312]: No targets found.
Apr 14 05:49:08 user nova-compute[71312]: iSNS:
Apr 14 05:49:08 user nova-compute[71312]: No targets found.
Apr 14 05:49:08 user nova-compute[71312]: STATIC:
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:08 user nova-compute[71312]: No targets found.
Apr 14 05:49:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:08 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:08 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489fbb9-6d56-4f1f-b8fb-5381f85a7b8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0582c2e-9aff-47bf-a759-2d605b483909]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc213760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff94e31-3449-45f0-8738-86b886a59c3d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[350bafe4-5c35-4906-a742-8888ec9fcb9e]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66c3a06-9b76-4545-80e9-72f6bff678da]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d1ad11-4f51-45f5-ad1c-5d74c7b164e7]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36101d9-0d16-46e7-8641-32b395476c35]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 902823936 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0236547c-a6a4-4b51-982d-2ac9e4c2176d]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66, portal: 172.16.0.220,3260]
Apr 14 05:49:08 user nova-compute[71312]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: WARNING nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance with vm_state active and task_state deleting.
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-unplugged-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-517e0448-275c-437e-9b1b-e81c27f404b4 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: WARNING nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-517e0448-275c-437e-9b1b-e81c27f404b4 for instance with vm_state active and task_state deleting.
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-unplugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4966c0d-81ad-4a8d-ba8c-8fac2291fa66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[22be44e7-6ed7-413e-8bb7-39eafcf77cd9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== disconnect_volume: return (413ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDdSsrwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:08 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddf5450-2372-498a-8fab-524e3d15c72c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:08 user nova-compute[71312]: No targets found.
Apr 14 05:49:08 user nova-compute[71312]: iSNS:
Apr 14 05:49:08 user nova-compute[71312]: No targets found.
Apr 14 05:49:08 user nova-compute[71312]: STATIC:
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8
Apr 14 05:49:08 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:08 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:08 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:08 user nova-compute[71312]: No targets found.
Apr 14 05:49:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:08 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:08 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[278e60a5-89f3-4764-aecd-6bb077abcb33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf846e8-4c43-44c1-bea4-0dd73b3edd0a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:08 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c41f8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32dfa5-2e72-4f5d-9972-d62662c30047]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8fe83-e824-4490-b5ab-f1ad111b1647]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[812b5ea4-4406-44fd-b845-63f8582a262a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: WARNING nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-6a5445f4-3781-433f-821c-d24cceffd920 for instance with vm_state active and task_state deleting.
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-unplugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: WARNING nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance with vm_state active and task_state deleting.
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-unplugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:08 user nova-compute[71312]: WARNING nova.compute.manager [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance with vm_state active and task_state deleting.
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb044a-8b09-45d2-84bc-2cb4495a27fe]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b76443d-a1d4-4bd4-8ac1-2d9c04151e17]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81ce33b-e442-420b-aacc-a9f3befb13cf]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a, portal: 172.16.0.220,3260]
Apr 14 05:49:08 user nova-compute[71312]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:08 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 1059061760 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90474409-44a2-4504-806d-b14d1201747a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eead3ebd-2178-40d2-bc54-ef71aba1d754]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== disconnect_volume: return (441ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRxfVZnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:09 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f2eda-dce6-458d-9c43-e392d8fcc4b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:09 user nova-compute[71312]: No targets found.
Apr 14 05:49:09 user nova-compute[71312]: iSNS:
Apr 14 05:49:09 user nova-compute[71312]: No targets found.
Apr 14 05:49:09 user nova-compute[71312]: STATIC:
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:09 user nova-compute[71312]: No targets found.
Apr 14 05:49:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:09 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:09 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f38c65-bffe-444d-8a89-6df18411e4db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c141844f-f1c5-4b9e-b59a-cd7072c4d8c9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:09 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c41f9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4963cec-4e4d-462c-a525-0f2f6bdec4e6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca17237-06c4-4fbe-9040-f469091dbe57]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10d30f9-2457-4c9f-9383-1839d4894a32]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80fd19d-4971-4bdc-a1ef-c9deaf1086b9]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5736d9f4-3cb5-48f6-9df3-486968f560bf]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.301s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6bdb10-a91c-4bb8-807f-325d7731fc01]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8, portal: 172.16.0.220,3260]
Apr 14 05:49:09 user nova-compute[71312]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb1fa-5bc5-450e-a928-f875d1a0e0f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.221s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8e6285-8176-4c45-885c-156d4ba5adef]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.775s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] <== disconnect_volume: return (776ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Deleting instance files /opt/stack/data/nova/instances/72d95729-7692-4774-b0fe-5747f558d7d6_del
Apr 14 05:49:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Deletion of /opt/stack/data/nova/instances/72d95729-7692-4774-b0fe-5747f558d7d6_del complete
Apr 14 05:49:09 user nova-compute[71312]: INFO nova.compute.manager [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Took 4.15 seconds to destroy the instance on the hypervisor.
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLcvJQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '8c38aa08-6830-4cc2-a66f-76daa76f9c10': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:09 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6ae10e-15af-40d3-8a41-5ccae92f73f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:09 user nova-compute[71312]: No targets found.
Apr 14 05:49:09 user nova-compute[71312]: iSNS:
Apr 14 05:49:09 user nova-compute[71312]: No targets found.
Apr 14 05:49:09 user nova-compute[71312]: STATIC:
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10
Apr 14 05:49:09 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:09 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:09 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:09 user nova-compute[71312]: No targets found.
Apr 14 05:49:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:09 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:09 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[74781188-efee-4e30-a9bd-2b7a3e149705]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ed87f-00de-4c3e-a2fe-f95dbcd7df3e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:10 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea222cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10'): ({'sdj'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Removing single pathed devices sdj {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[12084a13-c842-4530-8d29-c223bcf36f24]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e77db5a-9a19-41db-ab69-9d8b2e19dd2a]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Flushing IO for device /dev/sdj {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb7e8cf-22e4-4b38-854f-c6dcdd55a7ad]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.054s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65117a76-2443-41d6-aadc-84a11570af33]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] SCSI volumes sdj have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[80703d8b-43e4-4de6-a876-e9719ee7eb62]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7760c77d-79a7-4740-9395-b5e4ea2df2de]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10, portal: 172.16.0.220,3260]
Apr 14 05:49:10 user nova-compute[71312]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c38aa08-6830-4cc2-a66f-76daa76f9c10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[121b393b-55bd-4514-a65c-ac320707ba50]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] <== disconnect_volume: return (358ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'a7fd3290-73e1-438e-9301-4a668e50c3be', 'attached_at': '', 'detached_at': '', 'volume_id': '5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'serial'} {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] swap_volume: removing Cinder connection for volume 8c38aa08-6830-4cc2-a66f-76daa76f9c10 {{(pid=71312) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-changed-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing instance network info cache due to event network-changed-a33e4c43-ab16-4660-b246-9da472bef9a2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] Acquiring lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] Acquired lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Refreshing network info cache for port a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:10 user nova-compute[71312]: WARNING nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance with vm_state active and task_state deleting.
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-unplugged-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-unplugged-a161f793-130d-4fcf-8f39-163ca065ebbb for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Acquiring lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Lock "72d95729-7692-4774-b0fe-5747f558d7d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] No waiting events found dispatching network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:10 user nova-compute[71312]: WARNING nova.compute.manager [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received unexpected event network-vif-plugged-a161f793-130d-4fcf-8f39-163ca065ebbb for instance with vm_state active and task_state deleting.
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updated VIF entry in instance network info cache for port a33e4c43-ab16-4660-b246-9da472bef9a2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:49:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [{"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] Releasing lock "refresh_cache-921a3289-c406-4305-8e9b-8d218461c75c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:49:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] swap_volume: Updating volume 8c38aa08-6830-4cc2-a66f-76daa76f9c10 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NvQHLcGM", "auth_password": "vNTxoCPlHKQSBg", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "5d5e24bd-9225-4eb3-8359-d4c380c66e0d"}, "status": "reserved", "instance": "a7fd3290-73e1-438e-9301-4a668e50c3be", "attached_at": "", "detached_at": "", "volume_id": "5d5e24bd-9225-4eb3-8359-d4c380c66e0d", "serial": "5d5e24bd-9225-4eb3-8359-d4c380c66e0d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'no_device': None, 'attachment_id': '541cdc9d-4f07-485d-8bf8-99574ca542c5'} {{(pid=71312) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 05:49:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.542s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "921a3289-c406-4305-8e9b-8d218461c75c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:12 user nova-compute[71312]: INFO nova.compute.manager [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Terminating instance
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:12 user nova-compute[71312]: INFO nova.compute.manager [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Detaching volume 5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: INFO nova.virt.block_device [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Attempting to driver detach volume 5d5e24bd-9225-4eb3-8359-d4c380c66e0d from mountpoint /dev/vdb
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Attempting to detach device vdb from instance a7fd3290-73e1-438e-9301-4a668e50c3be from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:49:12 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:49:12 user nova-compute[71312]:   <source dev="/dev/sdi"/>
Apr 14 05:49:12 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:49:12 user nova-compute[71312]:   <serial>5d5e24bd-9225-4eb3-8359-d4c380c66e0d</serial>
Apr 14 05:49:12 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:49:12 user nova-compute[71312]: </disk>
Apr 14 05:49:12 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:49:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Successfully detached device vdb from instance a7fd3290-73e1-438e-9301-4a668e50c3be from the persistent domain config.
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7fd3290-73e1-438e-9301-4a668e50c3be from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:49:12 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:49:12 user nova-compute[71312]:   <source dev="/dev/sdi"/>
Apr 14 05:49:12 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:49:12 user nova-compute[71312]:   <serial>5d5e24bd-9225-4eb3-8359-d4c380c66e0d</serial>
Apr 14 05:49:12 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:49:12 user nova-compute[71312]: </disk>
Apr 14 05:49:12 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-deleted-b28d3b9e-1e32-47c0-9117-75dd980cf186 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:12 user nova-compute[71312]: INFO nova.compute.manager [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Neutron deleted interface b28d3b9e-1e32-47c0-9117-75dd980cf186; detaching it from the instance and deleting it from the info cache
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [{"id": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "address": "fa:16:3e:7e:a1:b5", "network": {"id": "b076dc22-7038-47cc-9fc1-285afb5578cf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253571004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9411547c-6e", "ovs_interfaceid": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Detach interface failed, port_id=b28d3b9e-1e32-47c0-9117-75dd980cf186, reason: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-deleted-9411547c-6ef0-4706-b74c-cf4f2d3e59a9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:12 user nova-compute[71312]: INFO nova.compute.manager [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Neutron deleted interface 9411547c-6ef0-4706-b74c-cf4f2d3e59a9; detaching it from the instance and deleting it from the info cache
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [{"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a161f793-130d-4fcf-8f39-163ca065ebbb", "address": "fa:16:3e:01:09:e4", "network": {"id": "6b529ca6-1438-4bad-a5ca-92070f391324", "bridge": "br-int", "label": "tempest-device-tagging-net2-1685478668", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa161f793-13", "ovs_interfaceid": "a161f793-130d-4fcf-8f39-163ca065ebbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Detach interface failed, port_id=9411547c-6ef0-4706-b74c-cf4f2d3e59a9, reason: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451353.185507, a7fd3290-73e1-438e-9301-4a668e50c3be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:49:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Successfully detached device vdb from instance a7fd3290-73e1-438e-9301-4a668e50c3be from the live domain config.
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvQHLcGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '5d5e24bd-9225-4eb3-8359-d4c380c66e0d': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:13 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-unplugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d2e27-0f43-4de3-acf9-78eed3a513d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:13 user nova-compute[71312]: No targets found.
Apr 14 05:49:13 user nova-compute[71312]: iSNS:
Apr 14 05:49:13 user nova-compute[71312]: No targets found.
Apr 14 05:49:13 user nova-compute[71312]: STATIC:
Apr 14 05:49:13 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:13 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:13 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:13 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:49:13 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:13 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:13 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d
Apr 14 05:49:13 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:13 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:13 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:49:13 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:13 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:13 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:49:13 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:13 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:13 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:13 user nova-compute[71312]: No targets found.
Apr 14 05:49:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:13 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:13 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b492df-89da-46af-8345-162dbe45c0b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8989583e-d909-4f66-8ab1-b704d418e168]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:13 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:13 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:13 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:13 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d (non-flash)
Apr 14 05:49:13 user nova-compute[71312]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:13 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:13 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:13 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc211b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d'): ({'sdi'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Removing single pathed devices sdi {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d22f08-a502-4f15-92e7-8b277852fa0e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d87106-2455-49ed-bef7-7367218c0938]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Flushing IO for device /dev/sdi {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e72a9-a3be-4ecc-9ada-d914bfcb4beb]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.058s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5970d5-e179-49b0-9246-630fbb2d2178]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] SCSI volumes sdi have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e540fe-05ee-4539-8e7a-c6fdd71c9586]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc226815-47f3-4354-a223-03f2354886f5]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260]
Apr 14 05:49:13 user nova-compute[71312]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5e24bd-9225-4eb3-8359-d4c380c66e0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac989d-6c21-440e-b6b8-39c9180c3123]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] <== disconnect_volume: return (404ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-unplugged-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-a33e4c43-ab16-4660-b246-9da472bef9a2 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Instance destroyed successfully.
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lazy-loading 'resources' on Instance uuid 921a3289-c406-4305-8e9b-8d218461c75c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "a33e4c43-ab16-4660-b246-9da472bef9a2", "address": "fa:16:3e:35:8c:4b", "network": {"id": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2028249574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa33e4c43-ab", "ovs_interfaceid": "a33e4c43-ab16-4660-b246-9da472bef9a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:8c:4b,bridge_name='br-int',has_traffic_filtering=True,id=a33e4c43-ab16-4660-b246-9da472bef9a2,network=Network(d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33e4c43-ab') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:8c:4b,bridge_name='br-int',has_traffic_filtering=True,id=a33e4c43-ab16-4660-b246-9da472bef9a2,network=Network(d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33e4c43-ab') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa33e4c43-ab, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: INFO os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:8c:4b,bridge_name='br-int',has_traffic_filtering=True,id=a33e4c43-ab16-4660-b246-9da472bef9a2,network=Network(d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa33e4c43-ab')
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "address": "fa:16:3e:18:30:49", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac3f3ff-ee", "ovs_interfaceid": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:49,bridge_name='br-int',has_traffic_filtering=True,id=dac3f3ff-eeab-49f2-a538-061dc6d4afc8,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdac3f3ff-ee') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:49,bridge_name='br-int',has_traffic_filtering=True,id=dac3f3ff-eeab-49f2-a538-061dc6d4afc8,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdac3f3ff-ee') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdac3f3ff-ee, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: INFO os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:30:49,bridge_name='br-int',has_traffic_filtering=True,id=dac3f3ff-eeab-49f2-a538-061dc6d4afc8,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdac3f3ff-ee')
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "5864d2bf-030a-4e87-a76c-49ca62310068", "address": "fa:16:3e:d3:f7:e1", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5864d2bf-03", "ovs_interfaceid": "5864d2bf-030a-4e87-a76c-49ca62310068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f7:e1,bridge_name='br-int',has_traffic_filtering=True,id=5864d2bf-030a-4e87-a76c-49ca62310068,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5864d2bf-03') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f7:e1,bridge_name='br-int',has_traffic_filtering=True,id=5864d2bf-030a-4e87-a76c-49ca62310068,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5864d2bf-03') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5864d2bf-03, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: INFO os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f7:e1,bridge_name='br-int',has_traffic_filtering=True,id=5864d2bf-030a-4e87-a76c-49ca62310068,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5864d2bf-03')
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "address": "fa:16:3e:78:7d:42", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e0efe93-27", "ovs_interfaceid": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7d:42,bridge_name='br-int',has_traffic_filtering=True,id=8e0efe93-278b-45a0-9ff4-bdf2f96775d0,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0efe93-27') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7d:42,bridge_name='br-int',has_traffic_filtering=True,id=8e0efe93-278b-45a0-9ff4-bdf2f96775d0,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0efe93-27') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e0efe93-27, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: INFO os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7d:42,bridge_name='br-int',has_traffic_filtering=True,id=8e0efe93-278b-45a0-9ff4-bdf2f96775d0,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e0efe93-27')
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "address": "fa:16:3e:c7:37:c4", "network": {"id": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-41124307", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6cc3c-0e", "ovs_interfaceid": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:37:c4,bridge_name='br-int',has_traffic_filtering=True,id=c5c6cc3c-0e1a-4108-b219-4159953b3d3e,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6cc3c-0e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:37:c4,bridge_name='br-int',has_traffic_filtering=True,id=c5c6cc3c-0e1a-4108-b219-4159953b3d3e,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6cc3c-0e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5c6cc3c-0e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: INFO os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:37:c4,bridge_name='br-int',has_traffic_filtering=True,id=c5c6cc3c-0e1a-4108-b219-4159953b3d3e,network=Network(3cdd9afa-ae91-4afe-9e17-a71ba88c19c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6cc3c-0e')
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "369eac45-a5df-4204-a809-3ba92cada623", "address": "fa:16:3e:1f:ca:0b", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369eac45-a5", "ovs_interfaceid": "369eac45-a5df-4204-a809-3ba92cada623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:0b,bridge_name='br-int',has_traffic_filtering=True,id=369eac45-a5df-4204-a809-3ba92cada623,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369eac45-a5') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:0b,bridge_name='br-int',has_traffic_filtering=True,id=369eac45-a5df-4204-a809-3ba92cada623,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369eac45-a5') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap369eac45-a5, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: INFO os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ca:0b,bridge_name='br-int',has_traffic_filtering=True,id=369eac45-a5df-4204-a809-3ba92cada623,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369eac45-a5')
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-817313929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-817313929',id=9,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A==',key_name='tempest-keypair-547240992',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea91450b53a4089beb572b96e80a902',ramdisk_id='',reservation_id='r-ts00rvi7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507690907',owner_user_name='tempest-TaggedBootDevicesTest-507690907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c09793a3c314acc93ba7c04d67117d0',uuid=921a3289-c406-4305-8e9b-8d218461c75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converting VIF {"id": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "address": "fa:16:3e:22:56:dd", "network": {"id": "f3371995-f205-4d29-a6d1-daca8ec77945", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051629551", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ea91450b53a4089beb572b96e80a902", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa77d8a-ca", "ovs_interfaceid": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa77d8a-ca') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa77d8a-ca') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaa77d8a-ca, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:14 user nova-compute[71312]: INFO os_vif [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:56:dd,bridge_name='br-int',has_traffic_filtering=True,id=aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64,network=Network(f3371995-f205-4d29-a6d1-daca8ec77945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa77d8a-ca')
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAVNSnfJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f344763e-d35e-41ac-b9b1-fb6e38e6d2cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:14 user nova-compute[71312]: No targets found.
Apr 14 05:49:14 user nova-compute[71312]: iSNS:
Apr 14 05:49:14 user nova-compute[71312]: No targets found.
Apr 14 05:49:14 user nova-compute[71312]: STATIC:
Apr 14 05:49:14 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:14 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:14 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:14 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:49:14 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:14 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:14 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1
Apr 14 05:49:14 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:14 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:14 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:49:14 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:14 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:14 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:14 user nova-compute[71312]: No targets found.
Apr 14 05:49:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:14 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:14 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe3e42b-d540-460e-aca8-fc0e0de267d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3004931-260b-400f-8e82-68f775cbd9df]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc212830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d87baf-d48a-40d2-9c3e-4986b59b7ca2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lazy-loading 'flavor' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ead9a95-3183-4b85-9bdf-000316ea960d]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe88b835-d6ed-4a18-af17-97e6f3411b34]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.213s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.078s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[75624e6c-f46a-45d0-9658-f4fb38faa33a]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a19ea7-1583-4cd1-996c-b7e1095344e2]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6be20-a8e3-4142-87ba-c3bd444724a5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1, portal: 172.16.0.220,3260]
Apr 14 05:49:14 user nova-compute[71312]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878c8790-7e7d-4f18-8a8a-4e5d604ff7f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[06392500-20c5-4c97-8525-ff81f2d49800]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== disconnect_volume: return (385ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhJMLElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca10d29f-d57f-4340-995a-cb2a20518998]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:14 user nova-compute[71312]: No targets found.
Apr 14 05:49:14 user nova-compute[71312]: iSNS:
Apr 14 05:49:14 user nova-compute[71312]: No targets found.
Apr 14 05:49:14 user nova-compute[71312]: STATIC:
Apr 14 05:49:14 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:14 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:14 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:14 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8
Apr 14 05:49:14 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:14 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:14 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:49:14 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:14 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:14 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:14 user nova-compute[71312]: No targets found.
Apr 14 05:49:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:14 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:14 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae55ae64-a841-484f-97a6-df6682ceef27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e61db74-2382-48fa-b841-457830d30bbd]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:14 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc1ae950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4e00ec-fd80-49e7-87a4-89fce1ed8c1b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128b229-42c9-47b5-aaa5-3545c55df5bc]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2092fc33-4b4f-4caf-bab8-6ed32a88ac59]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-unplugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-deleted-a161f793-130d-4fcf-8f39-163ca065ebbb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: INFO nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Neutron deleted interface a161f793-130d-4fcf-8f39-163ca065ebbb; detaching it from the instance and deleting it from the info cache
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [{"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "address": "fa:16:3e:93:5f:42", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8d96b7d-35", "ovs_interfaceid": "e8d96b7d-3503-458c-a3d6-614617cf0a6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Detach interface failed, port_id=a161f793-130d-4fcf-8f39-163ca065ebbb, reason: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: WARNING nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance with vm_state active and task_state deleting.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-unplugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: WARNING nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance with vm_state active and task_state deleting.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-deleted-e8d96b7d-3503-458c-a3d6-614617cf0a6e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: INFO nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Neutron deleted interface e8d96b7d-3503-458c-a3d6-614617cf0a6e; detaching it from the instance and deleting it from the info cache
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [{"id": "517e0448-275c-437e-9b1b-e81c27f404b4", "address": "fa:16:3e:9b:3c:09", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e0448-27", "ovs_interfaceid": "517e0448-275c-437e-9b1b-e81c27f404b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "address": "fa:16:3e:a6:1c:0f", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e5a8e2-6c", "ovs_interfaceid": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a5445f4-3781-433f-821c-d24cceffd920", "address": "fa:16:3e:2e:52:60", "network": {"id": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1996495375", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d2a45bad5274464a0b89b9e275e515e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5445f4-37", "ovs_interfaceid": "6a5445f4-3781-433f-821c-d24cceffd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05e3a64-ce8a-4cc0-93e8-7e4e82d99fdc]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Detach interface failed, port_id=e8d96b7d-3503-458c-a3d6-614617cf0a6e, reason: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f3892e-1510-45cd-ac46-989a5de62f10]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f860be-6461-4dbc-b735-2bade7c149a7]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8, portal: 172.16.0.220,3260]
Apr 14 05:49:15 user nova-compute[71312]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e76089a-274f-42de-b122-45493f24a8f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a2180d-39be-4da9-a1e7-cf14564f8e63]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== disconnect_volume: return (356ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTYDiWQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:15 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Took 5.37 seconds to deallocate network for instance.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: WARNING nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance with vm_state active and task_state deleting.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-unplugged-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-369eac45-a5df-4204-a809-3ba92cada623 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: WARNING nova.compute.manager [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-369eac45-a5df-4204-a809-3ba92cada623 for instance with vm_state active and task_state deleting.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd346f6-2c21-4f20-b9b9-a185c64a5d4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:15 user nova-compute[71312]: No targets found.
Apr 14 05:49:15 user nova-compute[71312]: iSNS:
Apr 14 05:49:15 user nova-compute[71312]: No targets found.
Apr 14 05:49:15 user nova-compute[71312]: STATIC:
Apr 14 05:49:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:15 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:15 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d
Apr 14 05:49:15 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:15 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:15 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:15 user nova-compute[71312]: No targets found.
Apr 14 05:49:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:15 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:15 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cbd582-5cd2-460a-a43c-3bae75795e37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4309d0ce-7814-405d-a99a-1f5a269e0e4d]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:15 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d (non-flash)
Apr 14 05:49:15 user nova-compute[71312]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc1aedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d'): ({'sdg'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Removing single pathed devices sdg {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4edb5d-6100-43f3-beb6-db0b7d5aea3f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2885dde8-e5ec-43f4-b3c2-8863435320a1]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Flushing IO for device /dev/sdg {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f331bb6b-38f8-410d-bdaa-b7b133c107bb]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aa42ab-a2f7-4eb1-af32-0e3309a9fee1]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] SCSI volumes sdg have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a4e59e-9fba-458b-86f1-7db225df8e02]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[47085280-ace3-4196-b671-1f4603cacb44]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d, portal: 172.16.0.220,3260]
Apr 14 05:49:15 user nova-compute[71312]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f35b9638-fe96-4afc-a249-05ed5a32851d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e8b452-993d-4f91-86b5-85f282ee024c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] <== disconnect_volume: return (304ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Deleting instance files /opt/stack/data/nova/instances/921a3289-c406-4305-8e9b-8d218461c75c_del
Apr 14 05:49:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Deletion of /opt/stack/data/nova/instances/921a3289-c406-4305-8e9b-8d218461c75c_del complete
Apr 14 05:49:15 user nova-compute[71312]: INFO nova.compute.manager [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Took 3.25 seconds to destroy the instance on the hypervisor.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: WARNING nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-a33e4c43-ab16-4660-b246-9da472bef9a2 for instance with vm_state active and task_state deleting.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-unplugged-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-5864d2bf-030a-4e87-a76c-49ca62310068 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: WARNING nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-5864d2bf-030a-4e87-a76c-49ca62310068 for instance with vm_state active and task_state deleting.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-unplugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-unplugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Acquiring lock "921a3289-c406-4305-8e9b-8d218461c75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "921a3289-c406-4305-8e9b-8d218461c75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] No waiting events found dispatching network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:15 user nova-compute[71312]: WARNING nova.compute.manager [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received unexpected event network-vif-plugged-c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance with vm_state active and task_state deleting.
Apr 14 05:49:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-b9ce2ebf-fbfd-466e-bbae-32155b41e7f6 req-3444f54e-b4db-45cf-8a25-ed299e77e813 service nova] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Received event network-vif-deleted-6a5445f4-3781-433f-821c-d24cceffd920 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:17 user nova-compute[71312]: INFO nova.compute.manager [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Took 2.49 seconds to detach 3 volumes for instance.
Apr 14 05:49:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:49:18 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:49:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:18 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Deleted allocations for instance 72d95729-7692-4774-b0fe-5747f558d7d6
Apr 14 05:49:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "72d95729-7692-4774-b0fe-5747f558d7d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.500s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:18 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:18 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Took 3.32 seconds to deallocate network for instance.
Apr 14 05:49:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-deleted-a33e4c43-ab16-4660-b246-9da472bef9a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-deleted-369eac45-a5df-4204-a809-3ba92cada623 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-deleted-aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-deleted-c5c6cc3c-0e1a-4108-b219-4159953b3d3e {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Received event network-vif-deleted-8e0efe93-278b-45a0-9ff4-bdf2f96775d0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:21 user nova-compute[71312]: INFO nova.compute.manager [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Took 2.46 seconds to detach 3 volumes for instance.
Apr 14 05:49:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:49:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:49:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:21 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Deleted allocations for instance 921a3289-c406-4305-8e9b-8d218461c75c
Apr 14 05:49:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "921a3289-c406-4305-8e9b-8d218461c75c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.464s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:22 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451347.6556792, 72d95729-7692-4774-b0fe-5747f558d7d6 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:49:22 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] VM Stopped (Lifecycle Event)
Apr 14 05:49:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-20b62543-58d8-4599-9353-a624ee9c12d0 None None] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:49:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:49:26 user nova-compute[71312]: INFO nova.compute.claims [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Claim successful on node user
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:49:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.policy [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:49:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Creating image(s)
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.206s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.127s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk 1073741824" returned: 0 in 0.059s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Successfully created port: afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:49:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Cannot resize image /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'migration_context' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Ensure instance console log exists: /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Successfully updated port: afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquired lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-changed-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Refreshing instance network info cache due to event network-changed-afbb14f2-3ce8-4993-b4cb-40e2c9567067. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] Acquiring lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating instance_info_cache with network_info: [{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Releasing lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance network_info: |[{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] Acquired lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.network.neutron [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Refreshing network info cache for port afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Start _get_guest_xml network_info=[{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:49:28 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:49:28 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:49:28 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:49:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:49:29 user nova-compute[71312]:   <uuid>8bc9e54a-dc25-421f-a380-a394b0867000</uuid>
Apr 14 05:49:29 user nova-compute[71312]:   <name>instance-0000000b</name>
Apr 14 05:49:29 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:49:29 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:49:29 user nova-compute[71312]:   <metadata>
Apr 14 05:49:29 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:49:29 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:49:29 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeTestJSON-server-680332699</nova:name>
Apr 14 05:49:29 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:49:28</nova:creationTime>
Apr 14 05:49:29 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:49:29 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:49:29 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:49:29 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:49:29 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:49:29 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:49:29 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:49:29 user nova-compute[71312]:       <nova:owner>
Apr 14 05:49:29 user nova-compute[71312]:         <nova:user uuid="3aa9911d299b409f9ccc8a55e7b3ec5b">tempest-AttachVolumeTestJSON-1872023683-project-member</nova:user>
Apr 14 05:49:29 user nova-compute[71312]:         <nova:project uuid="5c0f5758b623402393ec9eb273c7ae6f">tempest-AttachVolumeTestJSON-1872023683</nova:project>
Apr 14 05:49:29 user nova-compute[71312]:       </nova:owner>
Apr 14 05:49:29 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:49:29 user nova-compute[71312]:       <nova:ports>
Apr 14 05:49:29 user nova-compute[71312]:         <nova:port uuid="afbb14f2-3ce8-4993-b4cb-40e2c9567067">
Apr 14 05:49:29 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 05:49:29 user nova-compute[71312]:         </nova:port>
Apr 14 05:49:29 user nova-compute[71312]:       </nova:ports>
Apr 14 05:49:29 user nova-compute[71312]:     </nova:instance>
Apr 14 05:49:29 user nova-compute[71312]:   </metadata>
Apr 14 05:49:29 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:49:29 user nova-compute[71312]:     <system>
Apr 14 05:49:29 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:49:29 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:49:29 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:49:29 user nova-compute[71312]:       <entry name="serial">8bc9e54a-dc25-421f-a380-a394b0867000</entry>
Apr 14 05:49:29 user nova-compute[71312]:       <entry name="uuid">8bc9e54a-dc25-421f-a380-a394b0867000</entry>
Apr 14 05:49:29 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:49:29 user nova-compute[71312]:     </system>
Apr 14 05:49:29 user nova-compute[71312]:   </sysinfo>
Apr 14 05:49:29 user nova-compute[71312]:   <os>
Apr 14 05:49:29 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:49:29 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:49:29 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:49:29 user nova-compute[71312]:   </os>
Apr 14 05:49:29 user nova-compute[71312]:   <features>
Apr 14 05:49:29 user nova-compute[71312]:     <acpi/>
Apr 14 05:49:29 user nova-compute[71312]:     <apic/>
Apr 14 05:49:29 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:49:29 user nova-compute[71312]:   </features>
Apr 14 05:49:29 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:49:29 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:49:29 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:49:29 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:49:29 user nova-compute[71312]:   </clock>
Apr 14 05:49:29 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:49:29 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:49:29 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:49:29 user nova-compute[71312]:   </cpu>
Apr 14 05:49:29 user nova-compute[71312]:   <devices>
Apr 14 05:49:29 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:49:29 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:49:29 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk"/>
Apr 14 05:49:29 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:49:29 user nova-compute[71312]:     </disk>
Apr 14 05:49:29 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:49:29 user nova-compute[71312]:       <mac address="fa:16:3e:4c:94:55"/>
Apr 14 05:49:29 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:49:29 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:49:29 user nova-compute[71312]:       <target dev="tapafbb14f2-3c"/>
Apr 14 05:49:29 user nova-compute[71312]:     </interface>
Apr 14 05:49:29 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:49:29 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/console.log" append="off"/>
Apr 14 05:49:29 user nova-compute[71312]:     </serial>
Apr 14 05:49:29 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:49:29 user nova-compute[71312]:     <video>
Apr 14 05:49:29 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:49:29 user nova-compute[71312]:     </video>
Apr 14 05:49:29 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:49:29 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:49:29 user nova-compute[71312]:     </rng>
Apr 14 05:49:29 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:49:29 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:49:29 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:49:29 user nova-compute[71312]:     </memballoon>
Apr 14 05:49:29 user nova-compute[71312]:   </devices>
Apr 14 05:49:29 user nova-compute[71312]: </domain>
Apr 14 05:49:29 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:49:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG os_vif [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafbb14f2-3c, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapafbb14f2-3c, col_values=(('external_ids', {'iface-id': 'afbb14f2-3ce8-4993-b4cb-40e2c9567067', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:94:55', 'vm-uuid': '8bc9e54a-dc25-421f-a380-a394b0867000'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:29 user nova-compute[71312]: INFO os_vif [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c')
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451354.124203, 921a3289-c406-4305-8e9b-8d218461c75c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:49:29 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] VM Stopped (Lifecycle Event)
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No VIF found with MAC fa:16:3e:4c:94:55, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d97bbbad-8c95-49f0-948e-69eb962a2b4d None None] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updated VIF entry in instance network info cache for port afbb14f2-3ce8-4993-b4cb-40e2c9567067. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating instance_info_cache with network_info: [{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] Releasing lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:49:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:30 user nova-compute[71312]: WARNING nova.compute.manager [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state building and task_state spawning.
Apr 14 05:49:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451372.648614, 8bc9e54a-dc25-421f-a380-a394b0867000 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:49:32 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Resumed (Lifecycle Event)
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:49:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance spawned successfully.
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:32 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451372.651799, 8bc9e54a-dc25-421f-a380-a394b0867000 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:49:32 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Started (Lifecycle Event)
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:49:32 user nova-compute[71312]: INFO nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:32 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:49:32 user nova-compute[71312]: INFO nova.compute.manager [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Took 5.92 seconds to build instance.
Apr 14 05:49:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.015s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:32 user nova-compute[71312]: WARNING nova.compute.manager [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state active and task_state None.
Apr 14 05:49:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:49:39 user nova-compute[71312]: INFO nova.compute.claims [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Claim successful on node user
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:49:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:49:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Creating image(s)
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "/opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "/opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG nova.policy [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c0ba3adada84bb0975af922caaaa2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0538df9180154c65a4405779a49914b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk 1073741824" returned: 0 in 0.048s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Cannot resize image /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'migration_context' on Instance uuid b4a09d25-305a-4c5f-96db-e5b07dfaa494 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Successfully created port: 0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Ensure instance console log exists: /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Successfully updated port: 0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "refresh_cache-b4a09d25-305a-4c5f-96db-e5b07dfaa494" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquired lock "refresh_cache-b4a09d25-305a-4c5f-96db-e5b07dfaa494" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received event network-changed-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Refreshing instance network info cache due to event network-changed-0ceea987-cfef-4579-a50d-2a53ef497efa. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] Acquiring lock "refresh_cache-b4a09d25-305a-4c5f-96db-e5b07dfaa494" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Updating instance_info_cache with network_info: [{"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Releasing lock "refresh_cache-b4a09d25-305a-4c5f-96db-e5b07dfaa494" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Instance network_info: |[{"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] Acquired lock "refresh_cache-b4a09d25-305a-4c5f-96db-e5b07dfaa494" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Refreshing network info cache for port 0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Start _get_guest_xml network_info=[{"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:49:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:49:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-962541278',display_name='tempest-VolumesAdminNegativeTest-server-962541278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-962541278',id=12,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0538df9180154c65a4405779a49914b3',ramdisk_id='',reservation_id='r-2gqhbq4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-881296749',owner_user_name='tempest-VolumesAdminNegativeTest-881296749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:49:40Z,user_data=None,user_id='9c0ba3adada84bb0975af922caaaa2bc',uuid=b4a09d25-305a-4c5f-96db-e5b07dfaa494,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converting VIF {"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b8:91,bridge_name='br-int',has_traffic_filtering=True,id=0ceea987-cfef-4579-a50d-2a53ef497efa,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ceea987-cf') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'pci_devices' on Instance uuid b4a09d25-305a-4c5f-96db-e5b07dfaa494 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:49:41 user nova-compute[71312]:   <uuid>b4a09d25-305a-4c5f-96db-e5b07dfaa494</uuid>
Apr 14 05:49:41 user nova-compute[71312]:   <name>instance-0000000c</name>
Apr 14 05:49:41 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:49:41 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:49:41 user nova-compute[71312]:   <metadata>
Apr 14 05:49:41 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:49:41 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:49:41 user nova-compute[71312]:       <nova:name>tempest-VolumesAdminNegativeTest-server-962541278</nova:name>
Apr 14 05:49:41 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:49:41</nova:creationTime>
Apr 14 05:49:41 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:49:41 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:49:41 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:49:41 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:49:41 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:49:41 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:49:41 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:49:41 user nova-compute[71312]:       <nova:owner>
Apr 14 05:49:41 user nova-compute[71312]:         <nova:user uuid="9c0ba3adada84bb0975af922caaaa2bc">tempest-VolumesAdminNegativeTest-881296749-project-member</nova:user>
Apr 14 05:49:41 user nova-compute[71312]:         <nova:project uuid="0538df9180154c65a4405779a49914b3">tempest-VolumesAdminNegativeTest-881296749</nova:project>
Apr 14 05:49:41 user nova-compute[71312]:       </nova:owner>
Apr 14 05:49:41 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:49:41 user nova-compute[71312]:       <nova:ports>
Apr 14 05:49:41 user nova-compute[71312]:         <nova:port uuid="0ceea987-cfef-4579-a50d-2a53ef497efa">
Apr 14 05:49:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 05:49:41 user nova-compute[71312]:         </nova:port>
Apr 14 05:49:41 user nova-compute[71312]:       </nova:ports>
Apr 14 05:49:41 user nova-compute[71312]:     </nova:instance>
Apr 14 05:49:41 user nova-compute[71312]:   </metadata>
Apr 14 05:49:41 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:49:41 user nova-compute[71312]:     <system>
Apr 14 05:49:41 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:49:41 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:49:41 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:49:41 user nova-compute[71312]:       <entry name="serial">b4a09d25-305a-4c5f-96db-e5b07dfaa494</entry>
Apr 14 05:49:41 user nova-compute[71312]:       <entry name="uuid">b4a09d25-305a-4c5f-96db-e5b07dfaa494</entry>
Apr 14 05:49:41 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:49:41 user nova-compute[71312]:     </system>
Apr 14 05:49:41 user nova-compute[71312]:   </sysinfo>
Apr 14 05:49:41 user nova-compute[71312]:   <os>
Apr 14 05:49:41 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:49:41 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:49:41 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:49:41 user nova-compute[71312]:   </os>
Apr 14 05:49:41 user nova-compute[71312]:   <features>
Apr 14 05:49:41 user nova-compute[71312]:     <acpi/>
Apr 14 05:49:41 user nova-compute[71312]:     <apic/>
Apr 14 05:49:41 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:49:41 user nova-compute[71312]:   </features>
Apr 14 05:49:41 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:49:41 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:49:41 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:49:41 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:49:41 user nova-compute[71312]:   </clock>
Apr 14 05:49:41 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:49:41 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:49:41 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:49:41 user nova-compute[71312]:   </cpu>
Apr 14 05:49:41 user nova-compute[71312]:   <devices>
Apr 14 05:49:41 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:49:41 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:49:41 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk"/>
Apr 14 05:49:41 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:49:41 user nova-compute[71312]:     </disk>
Apr 14 05:49:41 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:49:41 user nova-compute[71312]:       <mac address="fa:16:3e:14:b8:91"/>
Apr 14 05:49:41 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:49:41 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:49:41 user nova-compute[71312]:       <target dev="tap0ceea987-cf"/>
Apr 14 05:49:41 user nova-compute[71312]:     </interface>
Apr 14 05:49:41 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:49:41 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/console.log" append="off"/>
Apr 14 05:49:41 user nova-compute[71312]:     </serial>
Apr 14 05:49:41 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:49:41 user nova-compute[71312]:     <video>
Apr 14 05:49:41 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:49:41 user nova-compute[71312]:     </video>
Apr 14 05:49:41 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:49:41 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:49:41 user nova-compute[71312]:     </rng>
Apr 14 05:49:41 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:49:41 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:49:41 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:49:41 user nova-compute[71312]:     </memballoon>
Apr 14 05:49:41 user nova-compute[71312]:   </devices>
Apr 14 05:49:41 user nova-compute[71312]: </domain>
Apr 14 05:49:41 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-962541278',display_name='tempest-VolumesAdminNegativeTest-server-962541278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-962541278',id=12,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0538df9180154c65a4405779a49914b3',ramdisk_id='',reservation_id='r-2gqhbq4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-881296749',owner_user_name='tempest-VolumesAdminNegativeTest-881296749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:49:40Z,user_data=None,user_id='9c0ba3adada84bb0975af922caaaa2bc',uuid=b4a09d25-305a-4c5f-96db-e5b07dfaa494,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converting VIF {"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b8:91,bridge_name='br-int',has_traffic_filtering=True,id=0ceea987-cfef-4579-a50d-2a53ef497efa,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ceea987-cf') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG os_vif [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b8:91,bridge_name='br-int',has_traffic_filtering=True,id=0ceea987-cfef-4579-a50d-2a53ef497efa,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ceea987-cf') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ceea987-cf, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ceea987-cf, col_values=(('external_ids', {'iface-id': '0ceea987-cfef-4579-a50d-2a53ef497efa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:b8:91', 'vm-uuid': 'b4a09d25-305a-4c5f-96db-e5b07dfaa494'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:41 user nova-compute[71312]: INFO os_vif [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b8:91,bridge_name='br-int',has_traffic_filtering=True,id=0ceea987-cfef-4579-a50d-2a53ef497efa,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ceea987-cf')
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:49:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] No VIF found with MAC fa:16:3e:14:b8:91, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:49:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Updated VIF entry in instance network info cache for port 0ceea987-cfef-4579-a50d-2a53ef497efa. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:49:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Updating instance_info_cache with network_info: [{"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] Releasing lock "refresh_cache-b4a09d25-305a-4c5f-96db-e5b07dfaa494" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:49:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received event network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] Acquiring lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] No waiting events found dispatching network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:43 user nova-compute[71312]: WARNING nova.compute.manager [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received unexpected event network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa for instance with vm_state building and task_state spawning.
Apr 14 05:49:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:44 user nova-compute[71312]: INFO nova.compute.manager [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Terminating instance
Apr 14 05:49:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-unplugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] No waiting events found dispatching network-vif-unplugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-unplugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Instance destroyed successfully.
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'resources' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066307036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2066307036',id=5,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A==',key_name='tempest-keypair-158582486',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f62071417bf445d8982419fb3cfb625',ramdisk_id='',reservation_id='r-zjd0ml6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1560780204',owner_user_name='tempest-TaggedAttachmentsTest-1560780204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d16c8d82ea4d38b34bef8f1a9e9f92',uuid=b91c97cd-ba56-4cd7-845d-28e6c9f37836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converting VIF {"id": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "address": "fa:16:3e:1d:f8:9d", "network": {"id": "11f5f265-3770-4817-9813-8039670d0f7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1385007536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f62071417bf445d8982419fb3cfb625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5264ebc-31", "ovs_interfaceid": "b5264ebc-31b1-434f-b555-abcbebb4c6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f8:9d,bridge_name='br-int',has_traffic_filtering=True,id=b5264ebc-31b1-434f-b555-abcbebb4c6e2,network=Network(11f5f265-3770-4817-9813-8039670d0f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5264ebc-31') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG os_vif [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f8:9d,bridge_name='br-int',has_traffic_filtering=True,id=b5264ebc-31b1-434f-b555-abcbebb4c6e2,network=Network(11f5f265-3770-4817-9813-8039670d0f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5264ebc-31') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5264ebc-31, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:45 user nova-compute[71312]: INFO os_vif [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:f8:9d,bridge_name='br-int',has_traffic_filtering=True,id=b5264ebc-31b1-434f-b555-abcbebb4c6e2,network=Network(11f5f265-3770-4817-9813-8039670d0f7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5264ebc-31')
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Deleting instance files /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836_del
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Deletion of /opt/stack/data/nova/instances/b91c97cd-ba56-4cd7-845d-28e6c9f37836_del complete
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.compute.manager [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received event network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] Acquiring lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] No waiting events found dispatching network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:45 user nova-compute[71312]: WARNING nova.compute.manager [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received unexpected event network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa for instance with vm_state building and task_state spawning.
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451385.5573528, b4a09d25-305a-4c5f-96db-e5b07dfaa494 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] VM Resumed (Lifecycle Event)
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Instance spawned successfully.
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451385.5587196, b4a09d25-305a-4c5f-96db-e5b07dfaa494 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] VM Started (Lifecycle Event)
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Took 6.09 seconds to spawn the instance on the hypervisor.
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "5e607038-6c40-417e-8c4f-f73f691e8672" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "5e607038-6c40-417e-8c4f-f73f691e8672" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.compute.manager [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Terminating instance
Apr 14 05:49:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Took 6.83 seconds to build instance.
Apr 14 05:49:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.992s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Instance destroyed successfully.
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'resources' on Instance uuid 5e607038-6c40-417e-8c4f-f73f691e8672 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1009909021',display_name='tempest-TestVolumeBootPattern-server-1009909021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1009909021',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:48:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-82ea3p0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:48:13Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=5e607038-6c40-417e-8c4f-f73f691e8672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "address": "fa:16:3e:07:78:03", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d477ae1-6e", "ovs_interfaceid": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:78:03,bridge_name='br-int',has_traffic_filtering=True,id=0d477ae1-6e7f-4888-8f7d-8d53a41f225c,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d477ae1-6e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_vif [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:78:03,bridge_name='br-int',has_traffic_filtering=True,id=0d477ae1-6e7f-4888-8f7d-8d53a41f225c,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d477ae1-6e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d477ae1-6e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:49:46 user nova-compute[71312]: INFO os_vif [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:78:03,bridge_name='br-int',has_traffic_filtering=True,id=0d477ae1-6e7f-4888-8f7d-8d53a41f225c,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d477ae1-6e')
Apr 14 05:49:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBlvVJQp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:49:46 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:46 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Took 1.43 seconds to deallocate network for instance.
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3028d210-58e8-400f-9868-383b87869fea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:49:46 user nova-compute[71312]: No targets found.
Apr 14 05:49:46 user nova-compute[71312]: iSNS:
Apr 14 05:49:46 user nova-compute[71312]: No targets found.
Apr 14 05:49:46 user nova-compute[71312]: STATIC:
Apr 14 05:49:46 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9
Apr 14 05:49:46 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:49:46 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:49:46 user nova-compute[71312]: FIRMWARE:
Apr 14 05:49:46 user nova-compute[71312]: No targets found.
Apr 14 05:49:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:49:46 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:49:46 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c227ce-4491-4787-8a74-93cfd38bbcae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b2a492-6afd-4fec-8d01-3e62788240af]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 (non-flash)
Apr 14 05:49:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc115bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9'): ({'sdh'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Removing single pathed devices sdh {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e130b44b-c9c1-4e16-bd76-df7fc7d35b13]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Acquiring lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] No waiting events found dispatching network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:46 user nova-compute[71312]: WARNING nova.compute.manager [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received unexpected event network-vif-plugged-b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance with vm_state deleted and task_state None.
Apr 14 05:49:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Received event network-vif-deleted-b5264ebc-31b1-434f-b555-abcbebb4c6e2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d50316e-617f-4cfe-b1b5-a8b1b28de6af]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flushing IO for device /dev/sdh {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b644d8c-89d7-43fb-aa08-e607110d3bc5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.055s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0ec83d-cd71-44c6-a500-032d59d26dd7]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] SCSI volumes sdh have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOddb39691-9066d160e8fc6d60', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ddb39691', '/dev/disk/by-id/scsi-23930363664313630') {{(pid=81359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17d3f45-6cda-4a0a-ae19-153c8d8e2bf2]: (4, None) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[680636cf-49f3-4be5-a5d6-ad2b107f3180]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d5f976-4b91-4051-bd48-cf259140c614]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9, portal: 172.16.0.220,3260]
Apr 14 05:49:47 user nova-compute[71312]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9, portal: 172.16.0.220,3260] successful.
Apr 14 05:49:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf01e259-c072-4086-adcd-cd304f7eb4a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e1e7e-dfab-46ef-9b1f-211592d6900c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== disconnect_volume: return (420ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:49:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Deleting instance files /opt/stack/data/nova/instances/5e607038-6c40-417e-8c4f-f73f691e8672_del
Apr 14 05:49:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Deletion of /opt/stack/data/nova/instances/5e607038-6c40-417e-8c4f-f73f691e8672_del complete
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:47 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Deleted allocations for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836
Apr 14 05:49:47 user nova-compute[71312]: INFO nova.compute.manager [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Took 1.38 seconds to destroy the instance on the hypervisor.
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "b91c97cd-ba56-4cd7-845d-28e6c9f37836" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.021s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received event network-vif-unplugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Acquiring lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] No waiting events found dispatching network-vif-unplugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received event network-vif-unplugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received event network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Acquiring lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Lock "5e607038-6c40-417e-8c4f-f73f691e8672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] No waiting events found dispatching network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:49:47 user nova-compute[71312]: WARNING nova.compute.manager [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received unexpected event network-vif-plugged-0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance with vm_state active and task_state deleting.
Apr 14 05:49:47 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:49:47 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Took 0.53 seconds to deallocate network for instance.
Apr 14 05:49:48 user nova-compute[71312]: INFO nova.compute.manager [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Took 0.89 seconds to detach 1 volumes for instance.
Apr 14 05:49:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Deleting volume: bf01e259-c072-4086-adcd-cd304f7eb4a9 {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 05:49:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:49:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:49:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-26f94ed9-6edc-45ae-b7d1-04a764aba27b req-54bf69c8-f8dd-4b26-b9a4-898b3570223a service nova] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Received event network-vif-deleted-0d477ae1-6e7f-4888-8f7d-8d53a41f225c {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:49:48 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:49:48 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:49:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:49 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Deleted allocations for instance 5e607038-6c40-417e-8c4f-f73f691e8672
Apr 14 05:49:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "5e607038-6c40-417e-8c4f-f73f691e8672" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.365s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:49:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:49:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:00 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451385.0678558, b91c97cd-ba56-4cd7-845d-28e6c9f37836 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:00 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] VM Stopped (Lifecycle Event)
Apr 14 05:50:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-369d7efc-cfac-438f-8fa1-f004edfd0dbf None None] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:01 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451386.5120502, 5e607038-6c40-417e-8c4f-f73f691e8672 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:01 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] VM Stopped (Lifecycle Event)
Apr 14 05:50:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1e935d0c-608d-4b51-a007-5380da21bc49 None None] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:02 user nova-compute[71312]: INFO nova.compute.manager [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Terminating instance
Apr 14 05:50:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:50:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received event network-vif-unplugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] No waiting events found dispatching network-vif-unplugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received event network-vif-unplugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:50:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Instance destroyed successfully.
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lazy-loading 'resources' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1100985565',display_name='tempest-TestVolumeSwap-server-1100985565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1100985565',id=6,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlWU7SVFm1tuCRrJXBYhvYIFp1UGrJ9o4IhyFdcD6RPSdDHPG4GW2uaPqr39Fgtg+WJUvkXExcaodD0utoyGFmJWSNDe/TcAU9fLYSQ/bG1lEvcb1BNS+WLp+by8swzYg==',key_name='tempest-keypair-2132035066',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dfd3e43c5734eb08d516280486d4beb',ramdisk_id='',reservation_id='r-c0g854a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1588834662',owner_user_name='tempest-TestVolumeSwap-1588834662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81250be3e69f4c68b8f583fe5f4284ae',uuid=a7fd3290-73e1-438e-9301-4a668e50c3be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Converting VIF {"id": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "address": "fa:16:3e:ce:95:6c", "network": {"id": "b7e63f6a-8aac-4de5-a83d-323daaf7d557", "bridge": "br-int", "label": "tempest-TestVolumeSwap-917933703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dfd3e43c5734eb08d516280486d4beb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4d27b7-aa", "ovs_interfaceid": "fd4d27b7-aa72-41ed-8d91-6410737250a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:95:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd4d27b7-aa72-41ed-8d91-6410737250a7,network=Network(b7e63f6a-8aac-4de5-a83d-323daaf7d557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4d27b7-aa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG os_vif [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:95:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd4d27b7-aa72-41ed-8d91-6410737250a7,network=Network(b7e63f6a-8aac-4de5-a83d-323daaf7d557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4d27b7-aa') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd4d27b7-aa, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:50:03 user nova-compute[71312]: INFO os_vif [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:95:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd4d27b7-aa72-41ed-8d91-6410737250a7,network=Network(b7e63f6a-8aac-4de5-a83d-323daaf7d557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4d27b7-aa')
Apr 14 05:50:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Deleting instance files /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be_del
Apr 14 05:50:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Deletion of /opt/stack/data/nova/instances/a7fd3290-73e1-438e-9301-4a668e50c3be_del complete
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:50:03 user nova-compute[71312]: INFO nova.compute.manager [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:50:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received event network-vif-deleted-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:05 user nova-compute[71312]: INFO nova.compute.manager [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Neutron deleted interface fd4d27b7-aa72-41ed-8d91-6410737250a7; detaching it from the instance and deleting it from the info cache
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.network.neutron [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:05 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Took 1.44 seconds to deallocate network for instance.
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Detach interface failed, port_id=fd4d27b7-aa72-41ed-8d91-6410737250a7, reason: Instance a7fd3290-73e1-438e-9301-4a668e50c3be could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received event network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] Acquiring lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] No waiting events found dispatching network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:05 user nova-compute[71312]: WARNING nova.compute.manager [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Received unexpected event network-vif-plugged-fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance with vm_state deleted and task_state None.
Apr 14 05:50:05 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:05 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8173MB free_disk=26.547260284423828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.700s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.166s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:06 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Deleted allocations for instance a7fd3290-73e1-438e-9301-4a668e50c3be
Apr 14 05:50:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "a7fd3290-73e1-438e-9301-4a668e50c3be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.305s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'flavor' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:07 user nova-compute[71312]: INFO nova.compute.manager [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Attaching volume 1ef50ac6-649b-4f1e-a49a-38c762ee04ad to /dev/vdb
Apr 14 05:50:07 user nova-compute[71312]: DEBUG os_brick.utils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb8b747-27ed-4010-8f32-50d4685cf8e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7028c963-5f56-4158-865f-26e34bdd6601]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de53c6-eea9-4e6d-b47c-ac4f1b2cd4d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7cdb97-b564-4f02-8b78-cca5a2417ac4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:50:07 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:50:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d454d5b-29f5-43bd-b456-2f50ff336af3]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG os_brick.utils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating existing volume attachment record: 9e12e158-d794-495f-909f-55064dc0a6ec {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:50:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:50:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:50:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:50:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:50:09 user nova-compute[71312]: INFO nova.compute.claims [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Claim successful on node user
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:50:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:50:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Creating image(s)
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.policy [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk 1073741824" returned: 0 in 0.056s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:50:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Cannot resize image /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'migration_context' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Ensure instance console log exists: /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Successfully created port: 2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:50:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Successfully updated port: 2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquired lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-changed-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Refreshing instance network info cache due to event network-changed-2d2429bd-952a-41bd-8807-48328561c775. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] Acquiring lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deiAzlaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:50:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:50:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:50:12 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3f0a42-05a7-4c49-b684-bb8bc10b4197]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:50:12 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3662cf-6621-48dc-a238-8a4d3b9bb5fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad] added
Apr 14 05:50:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8dae53-26ff-4ab6-b011-4993b6f4797b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5872bbb0-8d70-4b30-8ddb-3338aed0c63d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deiAzlaT {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deiAzlaT" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a2a911-6468-42d5-9165-ea216b76457c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'deiAzlaT'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[57728e9f-f29f-49ca-80b3-7bf9376f9ec6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4881d9-228c-41c1-8cb8-a4cb8af2503f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 05:50:12 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 05:50:12 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:50:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 05:50:12 user nova-compute[71312]: 
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Releasing lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance network_info: |[{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] Acquired lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Refreshing network info cache for port 2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Start _get_guest_xml network_info=[{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --login" returned: 0 in 0.130s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e486395-1a4d-4c1b-b69d-4cb1597f5437]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad, portal: 172.16.0.220,3260]
Apr 14 05:50:12 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad, portal: 172.16.0.220,3260] successful.
Apr 14 05:50:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:12 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-553121458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-553121458',id=13,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPD8RR/MXsr73U6E444PVtrgNrPdCCTH4RWjomjXjHxW2wSulD9GhjzDqJBH1L2kZm8JKbhhDzZOX+USbsm/JWzQtiZMhfScVGIoyCJ/BXIUdnRB7W6UoB0Q8LgoWJaYQ==',key_name='tempest-keypair-1417329181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-27lzq4z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=87153a66-bf2c-45f5-aa66-c94eaa6ea7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'pci_devices' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59ebad9-e2dc-49ab-bfbb-f4589390fd89]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:50:12 user nova-compute[71312]:   <uuid>87153a66-bf2c-45f5-aa66-c94eaa6ea7ea</uuid>
Apr 14 05:50:12 user nova-compute[71312]:   <name>instance-0000000d</name>
Apr 14 05:50:12 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:50:12 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:50:12 user nova-compute[71312]:   <metadata>
Apr 14 05:50:12 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:50:12 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:50:12 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-553121458</nova:name>
Apr 14 05:50:12 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:50:12</nova:creationTime>
Apr 14 05:50:12 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:50:12 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:50:12 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:50:12 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:50:12 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:50:12 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:50:12 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:50:12 user nova-compute[71312]:       <nova:owner>
Apr 14 05:50:12 user nova-compute[71312]:         <nova:user uuid="e7fece08f6f649bb89fc8ae5121bc2cc">tempest-AttachVolumeShelveTestJSON-1611001218-project-member</nova:user>
Apr 14 05:50:12 user nova-compute[71312]:         <nova:project uuid="a335a6c17041473ca2abf256cb30a25f">tempest-AttachVolumeShelveTestJSON-1611001218</nova:project>
Apr 14 05:50:12 user nova-compute[71312]:       </nova:owner>
Apr 14 05:50:12 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:50:12 user nova-compute[71312]:       <nova:ports>
Apr 14 05:50:12 user nova-compute[71312]:         <nova:port uuid="2d2429bd-952a-41bd-8807-48328561c775">
Apr 14 05:50:12 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 05:50:12 user nova-compute[71312]:         </nova:port>
Apr 14 05:50:12 user nova-compute[71312]:       </nova:ports>
Apr 14 05:50:12 user nova-compute[71312]:     </nova:instance>
Apr 14 05:50:12 user nova-compute[71312]:   </metadata>
Apr 14 05:50:12 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:50:12 user nova-compute[71312]:     <system>
Apr 14 05:50:12 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:50:12 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:50:12 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:50:12 user nova-compute[71312]:       <entry name="serial">87153a66-bf2c-45f5-aa66-c94eaa6ea7ea</entry>
Apr 14 05:50:12 user nova-compute[71312]:       <entry name="uuid">87153a66-bf2c-45f5-aa66-c94eaa6ea7ea</entry>
Apr 14 05:50:12 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:50:12 user nova-compute[71312]:     </system>
Apr 14 05:50:12 user nova-compute[71312]:   </sysinfo>
Apr 14 05:50:12 user nova-compute[71312]:   <os>
Apr 14 05:50:12 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:50:12 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:50:12 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:50:12 user nova-compute[71312]:   </os>
Apr 14 05:50:12 user nova-compute[71312]:   <features>
Apr 14 05:50:12 user nova-compute[71312]:     <acpi/>
Apr 14 05:50:12 user nova-compute[71312]:     <apic/>
Apr 14 05:50:12 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:50:12 user nova-compute[71312]:   </features>
Apr 14 05:50:12 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:50:12 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:50:12 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:50:12 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:50:12 user nova-compute[71312]:   </clock>
Apr 14 05:50:12 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:50:12 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:50:12 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:50:12 user nova-compute[71312]:   </cpu>
Apr 14 05:50:12 user nova-compute[71312]:   <devices>
Apr 14 05:50:12 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:50:12 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:50:12 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk"/>
Apr 14 05:50:12 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:50:12 user nova-compute[71312]:     </disk>
Apr 14 05:50:12 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:50:12 user nova-compute[71312]:       <mac address="fa:16:3e:6c:a9:eb"/>
Apr 14 05:50:12 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:12 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:50:12 user nova-compute[71312]:       <target dev="tap2d2429bd-95"/>
Apr 14 05:50:12 user nova-compute[71312]:     </interface>
Apr 14 05:50:12 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:50:12 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/console.log" append="off"/>
Apr 14 05:50:12 user nova-compute[71312]:     </serial>
Apr 14 05:50:12 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:50:12 user nova-compute[71312]:     <video>
Apr 14 05:50:12 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:12 user nova-compute[71312]:     </video>
Apr 14 05:50:12 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:50:12 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:50:12 user nova-compute[71312]:     </rng>
Apr 14 05:50:12 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:50:12 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:50:12 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:50:12 user nova-compute[71312]:     </memballoon>
Apr 14 05:50:12 user nova-compute[71312]:   </devices>
Apr 14 05:50:12 user nova-compute[71312]: </domain>
Apr 14 05:50:12 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-553121458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-553121458',id=13,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPD8RR/MXsr73U6E444PVtrgNrPdCCTH4RWjomjXjHxW2wSulD9GhjzDqJBH1L2kZm8JKbhhDzZOX+USbsm/JWzQtiZMhfScVGIoyCJ/BXIUdnRB7W6UoB0Q8LgoWJaYQ==',key_name='tempest-keypair-1417329181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-27lzq4z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=87153a66-bf2c-45f5-aa66-c94eaa6ea7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_vif [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4af069-a6b9-482f-a3d8-17a970a7e64f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:50:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:50:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d2429bd-95, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d2429bd-95, col_values=(('external_ids', {'iface-id': '2d2429bd-952a-41bd-8807-48328561c775', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:a9:eb', 'vm-uuid': '87153a66-bf2c-45f5-aa66-c94eaa6ea7ea'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2276af-1556-47f5-8c45-998197d49c80]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:12 user nova-compute[71312]: INFO os_vif [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95')
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No VIF found with MAC fa:16:3e:6c:a9:eb, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updated VIF entry in instance network info cache for port 2d2429bd-952a-41bd-8807-48328561c775. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] Releasing lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deiAzlaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23436393034363065', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436393034363065', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'flavor' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:50:13 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:50:13 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:50:13 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:50:13 user nova-compute[71312]:   <serial>1ef50ac6-649b-4f1e-a49a-38c762ee04ad</serial>
Apr 14 05:50:13 user nova-compute[71312]: </disk>
Apr 14 05:50:13 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No VIF found with MAC fa:16:3e:e3:aa:09, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.038s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] No waiting events found dispatching network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:14 user nova-compute[71312]: WARNING nova.compute.manager [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received unexpected event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 for instance with vm_state building and task_state spawning.
Apr 14 05:50:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:15 user nova-compute[71312]: INFO nova.compute.manager [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Rescuing
Apr 14 05:50:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:16 user nova-compute[71312]: WARNING nova.compute.manager [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state active and task_state rescuing.
Apr 14 05:50:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451416.8118114, 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] VM Resumed (Lifecycle Event)
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance spawned successfully.
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451416.8125648, 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] VM Started (Lifecycle Event)
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] No waiting events found dispatching network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:16 user nova-compute[71312]: WARNING nova.compute.manager [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received unexpected event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 for instance with vm_state building and task_state spawning.
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:50:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance destroyed successfully.
Apr 14 05:50:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Attempting a stable device rescue
Apr 14 05:50:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:50:16 user nova-compute[71312]: INFO nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Took 6.52 seconds to spawn the instance on the hypervisor.
Apr 14 05:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 05:50:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 05:50:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Creating image(s)
Apr 14 05:50:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "8beca99118516b9e994743abf0c4c66a81f524f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "8beca99118516b9e994743abf0c4c66a81f524f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:17 user nova-compute[71312]: INFO nova.compute.manager [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Took 7.22 seconds to build instance.
Apr 14 05:50:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.340s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:18 user nova-compute[71312]: WARNING nova.compute.manager [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state active and task_state rescuing.
Apr 14 05:50:18 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451403.6421635, a7fd3290-73e1-438e-9301-4a668e50c3be => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:18 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] VM Stopped (Lifecycle Event)
Apr 14 05:50:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3aeef881-779e-4454-b4f7-656cabb4159c None None] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6.part --force-share --output=json" returned: 0 in 0.236s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG nova.virt.images [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] f852b07b-a23b-4c28-bc31-15d3f7023dc2 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:50:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6.part /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6.part /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6.converted" returned: 0 in 0.370s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "8beca99118516b9e994743abf0c4c66a81f524f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.169s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "8beca99118516b9e994743abf0c4c66a81f524f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "8beca99118516b9e994743abf0c4c66a81f524f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6 --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6,backing_fmt=raw /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6,backing_fmt=raw /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue" returned: 0 in 0.050s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "8beca99118516b9e994743abf0c4c66a81f524f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'migration_context' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Start _get_guest_xml network_info=[{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "vif_mac": "fa:16:3e:e3:aa:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f852b07b-a23b-4c28-bc31-15d3f7023dc2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '9e12e158-d794-495f-909f-55064dc0a6ec', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deiAzlaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4a200376-4747-49ed-96d4-3fe9ac338dcc', 'attached_at': '', 'detached_at': '', 'volume_id': '1ef50ac6-649b-4f1e-a49a-38c762ee04ad', 'serial': '1ef50ac6-649b-4f1e-a49a-38c762ee04ad'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'resources' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deiAzlaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:50:19 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:50:19 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:50:19 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f31c3-9f85-4588-a94f-56357f622188]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = deiAzlaT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 05:50:19 user nova-compute[71312]: node.name = iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad
Apr 14 05:50:19 user nova-compute[71312]: node.tpgt = -1
Apr 14 05:50:19 user nova-compute[71312]: node.startup = automatic
Apr 14 05:50:19 user nova-compute[71312]: node.leading_login = No
Apr 14 05:50:19 user nova-compute[71312]: iface.iscsi_ifacename = default
Apr 14 05:50:19 user nova-compute[71312]: iface.net_ifacename = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.ipaddress = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.prefix_len = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.hwaddress = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.transport_name = tcp
Apr 14 05:50:19 user nova-compute[71312]: iface.initiatorname = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.state = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.vlan_id = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.vlan_priority = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.vlan_state = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.iface_num = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.mtu = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.port = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.bootproto = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.subnet_mask = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.gateway = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.dhcp_alt_client_id = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.dhcp_dns = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.dhcp_learn_iqn = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.dhcp_vendor_id_state = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.dhcp_vendor_id = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.dhcp_slp_da = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.fragmentation = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.gratuitous_arp = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.incoming_forwarding = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.tos_state = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.tos = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.ttl = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.delayed_ack = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.tcp_nagle = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.tcp_wsf_state = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.tcp_wsf = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.tcp_timer_scale = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.tcp_timestamp = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.redirect = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.def_task_mgmt_timeout = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.header_digest = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.data_digest = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.immediate_data = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.initial_r2t = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.data_seq_inorder = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.data_pdu_inorder = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.erl = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.max_receive_data_len = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.first_burst_len = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.max_outstanding_r2t = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.max_burst_len = 0
Apr 14 05:50:19 user nova-compute[71312]: iface.chap_auth = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.bidi_chap = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.strict_login_compliance = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.discovery_auth = <empty>
Apr 14 05:50:19 user nova-compute[71312]: iface.discovery_logout = <empty>
Apr 14 05:50:19 user nova-compute[71312]: node.discovery_address = <empty>
Apr 14 05:50:19 user nova-compute[71312]: node.discovery_port = 0
Apr 14 05:50:19 user nova-compute[71312]: node.discovery_type = static
Apr 14 05:50:19 user nova-compute[71312]: node.session.initial_cmdsn = 0
Apr 14 05:50:19 user nova-compute[71312]: node.session.initial_login_retry_max = 8
Apr 14 05:50:19 user nova-compute[71312]: node.session.xmit_thread_priority = -20
Apr 14 05:50:19 user nova-compute[71312]: node.session.cmds_max = 128
Apr 14 05:50:19 user nova-compute[71312]: node.session.queue_depth = 32
Apr 14 05:50:19 user nova-compute[71312]: node.session.nr_sessions = 1
Apr 14 05:50:19 user nova-compute[71312]: node.session.auth.authmethod = CHAP
Apr 14 05:50:19 user nova-compute[71312]: node.session.auth.username = deiAzlaT
Apr 14 05:50:19 user nova-compute[71312]: node.session.auth.password = ***
Apr 14 05:50:19 user nova-compute[71312]: node.session.auth.username_in = <empty>
Apr 14 05:50:19 user nova-compute[71312]: node.session.auth.password_in = <empty>
Apr 14 05:50:19 user nova-compute[71312]: node.session.auth.chap_algs = MD5
Apr 14 05:50:19 user nova-compute[71312]: node.session.timeo.replacement_timeout = 120
Apr 14 05:50:19 user nova-compute[71312]: node.session.err_timeo.abort_timeout = 15
Apr 14 05:50:19 user nova-compute[71312]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 05:50:19 user nova-compute[71312]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 05:50:19 user nova-compute[71312]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.FastAbort = Yes
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.InitialR2T = No
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.ImmediateData = Yes
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.MaxConnections = 1
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 05:50:19 user nova-compute[71312]: node.session.iscsi.ERL = 0
Apr 14 05:50:19 user nova-compute[71312]: node.session.scan = manual
Apr 14 05:50:19 user nova-compute[71312]: node.session.reopen_max = 0
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].address = 172.16.0.220
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].port = 3260
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].startup = manual
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].tcp.window_size = 524288
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].tcp.type_of_service = 0
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].timeo.logout_timeout = 15
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].timeo.login_timeout = 15
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].timeo.auth_timeout = 45
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].iscsi.DataDigest = None
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].iscsi.IFMarker = No
Apr 14 05:50:19 user nova-compute[71312]: node.conn[0].iscsi.OFMarker = No
Apr 14 05:50:19 user nova-compute[71312]: # END RECORD
Apr 14 05:50:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6db766-64a7-4b7a-b640-702ce528efd1]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf83b56-3cb0-4730-bd6a-c917a471a808]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deiAzlaT {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deiAzlaT" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85c240c-db13-4dda-b82d-3898d5fc6013]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'deiAzlaT'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc80f59-a8b2-4e72-9769-b6c6e5ee4e5e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edfc79e-6d2e-4005-b7a2-6f422320a517]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:50:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:50:19 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.138s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2a18de-c8a0-44eb-9b60-b1a5403255a0]: (4, ('0 0 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deiAzlaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.161s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] <== connect_volume: return (162ms) {'type': 'block', 'scsi_wwn': '23436393034363065', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436393034363065', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-586479502',display_name='tempest-ServerStableDeviceRescueTest-server-586479502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-586479502',id=2,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnWgZSvStsIdBllMYITUwmuqQ//xCF9VZ+dweCxYVF5I1+XtbvXBqpCGg+3VG6koL7nHVoTJQeDf4gOGrVLkZrfLOdLZg4fZIrvOc8FP4FDDoxD5XtGdp4wyTnOCB5exw==',key_name='tempest-keypair-1292881497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93092d7530694b63aba0a085051c0520',ramdisk_id='',reservation_id='r-t4mr1l4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1786618110',owner_user_name='tempest-ServerStableDeviceRescueTest-1786618110-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e733b69143e045bcbe99d823b02aab83',uuid=4a200376-4747-49ed-96d4-3fe9ac338dcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "vif_mac": "fa:16:3e:e3:aa:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Converting VIF {"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "vif_mac": "fa:16:3e:e3:aa:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:aa:09,bridge_name='br-int',has_traffic_filtering=True,id=b5de51fa-6654-4f76-89df-063a4d6ad4f0,network=Network(94d980c4-edf3-4d22-8ae3-b029ad2d4516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5de51fa-66') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:50:19 user nova-compute[71312]:   <uuid>4a200376-4747-49ed-96d4-3fe9ac338dcc</uuid>
Apr 14 05:50:19 user nova-compute[71312]:   <name>instance-00000002</name>
Apr 14 05:50:19 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:50:19 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:50:19 user nova-compute[71312]:   <metadata>
Apr 14 05:50:19 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:50:19 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:50:19 user nova-compute[71312]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-586479502</nova:name>
Apr 14 05:50:19 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:50:19</nova:creationTime>
Apr 14 05:50:19 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:50:19 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:50:19 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:50:19 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:50:19 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:50:19 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:50:19 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:50:19 user nova-compute[71312]:       <nova:owner>
Apr 14 05:50:19 user nova-compute[71312]:         <nova:user uuid="e733b69143e045bcbe99d823b02aab83">tempest-ServerStableDeviceRescueTest-1786618110-project-member</nova:user>
Apr 14 05:50:19 user nova-compute[71312]:         <nova:project uuid="93092d7530694b63aba0a085051c0520">tempest-ServerStableDeviceRescueTest-1786618110</nova:project>
Apr 14 05:50:19 user nova-compute[71312]:       </nova:owner>
Apr 14 05:50:19 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:50:19 user nova-compute[71312]:       <nova:ports>
Apr 14 05:50:19 user nova-compute[71312]:         <nova:port uuid="b5de51fa-6654-4f76-89df-063a4d6ad4f0">
Apr 14 05:50:19 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 05:50:19 user nova-compute[71312]:         </nova:port>
Apr 14 05:50:19 user nova-compute[71312]:       </nova:ports>
Apr 14 05:50:19 user nova-compute[71312]:     </nova:instance>
Apr 14 05:50:19 user nova-compute[71312]:   </metadata>
Apr 14 05:50:19 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:50:19 user nova-compute[71312]:     <system>
Apr 14 05:50:19 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:50:19 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:50:19 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:50:19 user nova-compute[71312]:       <entry name="serial">4a200376-4747-49ed-96d4-3fe9ac338dcc</entry>
Apr 14 05:50:19 user nova-compute[71312]:       <entry name="uuid">4a200376-4747-49ed-96d4-3fe9ac338dcc</entry>
Apr 14 05:50:19 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:50:19 user nova-compute[71312]:     </system>
Apr 14 05:50:19 user nova-compute[71312]:   </sysinfo>
Apr 14 05:50:19 user nova-compute[71312]:   <os>
Apr 14 05:50:19 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:50:19 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:50:19 user nova-compute[71312]:   </os>
Apr 14 05:50:19 user nova-compute[71312]:   <features>
Apr 14 05:50:19 user nova-compute[71312]:     <acpi/>
Apr 14 05:50:19 user nova-compute[71312]:     <apic/>
Apr 14 05:50:19 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:50:19 user nova-compute[71312]:   </features>
Apr 14 05:50:19 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:50:19 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:50:19 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:50:19 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:50:19 user nova-compute[71312]:   </clock>
Apr 14 05:50:19 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:50:19 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:50:19 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:50:19 user nova-compute[71312]:   </cpu>
Apr 14 05:50:19 user nova-compute[71312]:   <devices>
Apr 14 05:50:19 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:50:19 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:50:19 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk"/>
Apr 14 05:50:19 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:50:19 user nova-compute[71312]:     </disk>
Apr 14 05:50:19 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:50:19 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:50:19 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 05:50:19 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 05:50:19 user nova-compute[71312]:       <serial>1ef50ac6-649b-4f1e-a49a-38c762ee04ad</serial>
Apr 14 05:50:19 user nova-compute[71312]:     </disk>
Apr 14 05:50:19 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:50:19 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:50:19 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue"/>
Apr 14 05:50:19 user nova-compute[71312]:       <target dev="vdc" bus="virtio"/>
Apr 14 05:50:19 user nova-compute[71312]:       <boot order="1"/>
Apr 14 05:50:19 user nova-compute[71312]:     </disk>
Apr 14 05:50:19 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:50:19 user nova-compute[71312]:       <mac address="fa:16:3e:e3:aa:09"/>
Apr 14 05:50:19 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:19 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:50:19 user nova-compute[71312]:       <target dev="tapb5de51fa-66"/>
Apr 14 05:50:19 user nova-compute[71312]:     </interface>
Apr 14 05:50:19 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:50:19 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/console.log" append="off"/>
Apr 14 05:50:19 user nova-compute[71312]:     </serial>
Apr 14 05:50:19 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:50:19 user nova-compute[71312]:     <video>
Apr 14 05:50:19 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:19 user nova-compute[71312]:     </video>
Apr 14 05:50:19 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:50:19 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:50:19 user nova-compute[71312]:     </rng>
Apr 14 05:50:19 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:50:19 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:50:19 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:50:19 user nova-compute[71312]:     </memballoon>
Apr 14 05:50:19 user nova-compute[71312]:   </devices>
Apr 14 05:50:19 user nova-compute[71312]: </domain>
Apr 14 05:50:19 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:50:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance destroyed successfully.
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] No VIF found with MAC fa:16:3e:e3:aa:09, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:21 user nova-compute[71312]: WARNING nova.compute.manager [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state active and task_state rescuing.
Apr 14 05:50:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:23 user nova-compute[71312]: WARNING nova.compute.manager [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state active and task_state rescuing.
Apr 14 05:50:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 4a200376-4747-49ed-96d4-3fe9ac338dcc due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 05:50:24 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451424.2357616, 4a200376-4747-49ed-96d4-3fe9ac338dcc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] VM Resumed (Lifecycle Event)
Apr 14 05:50:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:50:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 05:50:24 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451424.2483053, 4a200376-4747-49ed-96d4-3fe9ac338dcc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] VM Started (Lifecycle Event)
Apr 14 05:50:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:50:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:50:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:50:32 user nova-compute[71312]: INFO nova.compute.claims [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Claim successful on node user
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:50:33 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.policy [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92aac6d019db4be3bfe3016653ccc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e242403698514922aad5ec97ae17b1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:50:33 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Creating image(s)
Apr 14 05:50:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "/opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "/opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "/opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.201s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.190s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk 1073741824" returned: 0 in 0.069s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.175s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Cannot resize image /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'migration_context' on Instance uuid 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Ensure instance console log exists: /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Successfully created port: eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Successfully updated port: eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "refresh_cache-91db166d-7af7-4aa7-90bd-a003048effa5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquired lock "refresh_cache-91db166d-7af7-4aa7-90bd-a003048effa5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received event network-changed-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Refreshing instance network info cache due to event network-changed-eacc5441-0087-4493-832f-39661bf968e0. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] Acquiring lock "refresh_cache-91db166d-7af7-4aa7-90bd-a003048effa5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "5c09efbc-4c94-4130-a927-9239420b7d37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:50:37 user nova-compute[71312]: INFO nova.compute.claims [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Claim successful on node user
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Updating instance_info_cache with network_info: [{"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Releasing lock "refresh_cache-91db166d-7af7-4aa7-90bd-a003048effa5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Instance network_info: |[{"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] Acquired lock "refresh_cache-91db166d-7af7-4aa7-90bd-a003048effa5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Refreshing network info cache for port eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Start _get_guest_xml network_info=[{"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:50:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2114465759',display_name='tempest-VolumesSnapshotTestJSON-instance-2114465759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2114465759',id=14,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e242403698514922aad5ec97ae17b1c8',ramdisk_id='',reservation_id='r-0woik53u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-186190223',owner_user_name='tempest-VolumesSnapshotTestJSON-186190223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:50:34Z,user_data=None,user_id='92aac6d019db4be3bfe3016653ccc7a0',uuid=91db166d-7af7-4aa7-90bd-a003048effa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converting VIF {"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:1a,bridge_name='br-int',has_traffic_filtering=True,id=eacc5441-0087-4493-832f-39661bf968e0,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacc5441-00') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'pci_devices' on Instance uuid 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:50:37 user nova-compute[71312]:   <uuid>91db166d-7af7-4aa7-90bd-a003048effa5</uuid>
Apr 14 05:50:37 user nova-compute[71312]:   <name>instance-0000000e</name>
Apr 14 05:50:37 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:50:37 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:50:37 user nova-compute[71312]:   <metadata>
Apr 14 05:50:37 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:50:37 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:50:37 user nova-compute[71312]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2114465759</nova:name>
Apr 14 05:50:37 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:50:37</nova:creationTime>
Apr 14 05:50:37 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:50:37 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:50:37 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:50:37 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:50:37 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:50:37 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:50:37 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:50:37 user nova-compute[71312]:       <nova:owner>
Apr 14 05:50:37 user nova-compute[71312]:         <nova:user uuid="92aac6d019db4be3bfe3016653ccc7a0">tempest-VolumesSnapshotTestJSON-186190223-project-member</nova:user>
Apr 14 05:50:37 user nova-compute[71312]:         <nova:project uuid="e242403698514922aad5ec97ae17b1c8">tempest-VolumesSnapshotTestJSON-186190223</nova:project>
Apr 14 05:50:37 user nova-compute[71312]:       </nova:owner>
Apr 14 05:50:37 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:50:37 user nova-compute[71312]:       <nova:ports>
Apr 14 05:50:37 user nova-compute[71312]:         <nova:port uuid="eacc5441-0087-4493-832f-39661bf968e0">
Apr 14 05:50:37 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 05:50:37 user nova-compute[71312]:         </nova:port>
Apr 14 05:50:37 user nova-compute[71312]:       </nova:ports>
Apr 14 05:50:37 user nova-compute[71312]:     </nova:instance>
Apr 14 05:50:37 user nova-compute[71312]:   </metadata>
Apr 14 05:50:37 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:50:37 user nova-compute[71312]:     <system>
Apr 14 05:50:37 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:50:37 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:50:37 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:50:37 user nova-compute[71312]:       <entry name="serial">91db166d-7af7-4aa7-90bd-a003048effa5</entry>
Apr 14 05:50:37 user nova-compute[71312]:       <entry name="uuid">91db166d-7af7-4aa7-90bd-a003048effa5</entry>
Apr 14 05:50:37 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:50:37 user nova-compute[71312]:     </system>
Apr 14 05:50:37 user nova-compute[71312]:   </sysinfo>
Apr 14 05:50:37 user nova-compute[71312]:   <os>
Apr 14 05:50:37 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:50:37 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:50:37 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:50:37 user nova-compute[71312]:   </os>
Apr 14 05:50:37 user nova-compute[71312]:   <features>
Apr 14 05:50:37 user nova-compute[71312]:     <acpi/>
Apr 14 05:50:37 user nova-compute[71312]:     <apic/>
Apr 14 05:50:37 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:50:37 user nova-compute[71312]:   </features>
Apr 14 05:50:37 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:50:37 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:50:37 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:50:37 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:50:37 user nova-compute[71312]:   </clock>
Apr 14 05:50:37 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:50:37 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:50:37 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:50:37 user nova-compute[71312]:   </cpu>
Apr 14 05:50:37 user nova-compute[71312]:   <devices>
Apr 14 05:50:37 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:50:37 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:50:37 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk"/>
Apr 14 05:50:37 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:50:37 user nova-compute[71312]:     </disk>
Apr 14 05:50:37 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:50:37 user nova-compute[71312]:       <mac address="fa:16:3e:bd:82:1a"/>
Apr 14 05:50:37 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:37 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:50:37 user nova-compute[71312]:       <target dev="tapeacc5441-00"/>
Apr 14 05:50:37 user nova-compute[71312]:     </interface>
Apr 14 05:50:37 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:50:37 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/console.log" append="off"/>
Apr 14 05:50:37 user nova-compute[71312]:     </serial>
Apr 14 05:50:37 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:50:37 user nova-compute[71312]:     <video>
Apr 14 05:50:37 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:37 user nova-compute[71312]:     </video>
Apr 14 05:50:37 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:50:37 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:50:37 user nova-compute[71312]:     </rng>
Apr 14 05:50:37 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:50:37 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:50:37 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:50:37 user nova-compute[71312]:     </memballoon>
Apr 14 05:50:37 user nova-compute[71312]:   </devices>
Apr 14 05:50:37 user nova-compute[71312]: </domain>
Apr 14 05:50:37 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2114465759',display_name='tempest-VolumesSnapshotTestJSON-instance-2114465759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2114465759',id=14,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e242403698514922aad5ec97ae17b1c8',ramdisk_id='',reservation_id='r-0woik53u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-186190223',owner_user_name='tempest-VolumesSnapshotTestJSON-186190223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:50:34Z,user_data=None,user_id='92aac6d019db4be3bfe3016653ccc7a0',uuid=91db166d-7af7-4aa7-90bd-a003048effa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converting VIF {"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:1a,bridge_name='br-int',has_traffic_filtering=True,id=eacc5441-0087-4493-832f-39661bf968e0,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacc5441-00') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG os_vif [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:1a,bridge_name='br-int',has_traffic_filtering=True,id=eacc5441-0087-4493-832f-39661bf968e0,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacc5441-00') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeacc5441-00, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeacc5441-00, col_values=(('external_ids', {'iface-id': 'eacc5441-0087-4493-832f-39661bf968e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:82:1a', 'vm-uuid': '91db166d-7af7-4aa7-90bd-a003048effa5'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:37 user nova-compute[71312]: INFO os_vif [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:1a,bridge_name='br-int',has_traffic_filtering=True,id=eacc5441-0087-4493-832f-39661bf968e0,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacc5441-00')
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No VIF found with MAC fa:16:3e:bd:82:1a, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:50:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.policy [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:50:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Creating image(s)
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "/opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "/opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Updated VIF entry in instance network info cache for port eacc5441-0087-4493-832f-39661bf968e0. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Updating instance_info_cache with network_info: [{"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] Releasing lock "refresh_cache-91db166d-7af7-4aa7-90bd-a003048effa5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk 1073741824" returned: 0 in 0.060s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Cannot resize image /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG nova.objects.instance [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'migration_context' on Instance uuid 5c09efbc-4c94-4130-a927-9239420b7d37 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Ensure instance console log exists: /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received event network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] No waiting events found dispatching network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:39 user nova-compute[71312]: WARNING nova.compute.manager [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received unexpected event network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 for instance with vm_state building and task_state spawning.
Apr 14 05:50:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Successfully created port: 056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Successfully updated port: 056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquired lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received event network-changed-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Refreshing instance network info cache due to event network-changed-056b7c6a-6fa1-4a4a-ba45-3084cfc33643. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] Acquiring lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updating instance_info_cache with network_info: [{"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Releasing lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Instance network_info: |[{"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] Acquired lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Refreshing network info cache for port 056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Start _get_guest_xml network_info=[{"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:50:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:40 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1574771686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1574771686',id=15,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-cvkivi41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:50:38Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=5c09efbc-4c94-4130-a927-9239420b7d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=056b7c6a-6fa1-4a4a-ba45-3084cfc33643,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056b7c6a-6f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c09efbc-4c94-4130-a927-9239420b7d37 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:50:40 user nova-compute[71312]:   <uuid>5c09efbc-4c94-4130-a927-9239420b7d37</uuid>
Apr 14 05:50:40 user nova-compute[71312]:   <name>instance-0000000f</name>
Apr 14 05:50:40 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:50:40 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:50:40 user nova-compute[71312]:   <metadata>
Apr 14 05:50:40 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:50:40 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:50:40 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1574771686</nova:name>
Apr 14 05:50:40 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:50:40</nova:creationTime>
Apr 14 05:50:40 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:50:40 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:50:40 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:50:40 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:50:40 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:50:40 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:50:40 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:50:40 user nova-compute[71312]:       <nova:owner>
Apr 14 05:50:40 user nova-compute[71312]:         <nova:user uuid="c4946885e01a4f0da206d796027b3c9f">tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member</nova:user>
Apr 14 05:50:40 user nova-compute[71312]:         <nova:project uuid="7034e2177823496a861a1601a5c06fe4">tempest-ServerBootFromVolumeStableRescueTest-315541711</nova:project>
Apr 14 05:50:40 user nova-compute[71312]:       </nova:owner>
Apr 14 05:50:40 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:50:40 user nova-compute[71312]:       <nova:ports>
Apr 14 05:50:40 user nova-compute[71312]:         <nova:port uuid="056b7c6a-6fa1-4a4a-ba45-3084cfc33643">
Apr 14 05:50:40 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 05:50:40 user nova-compute[71312]:         </nova:port>
Apr 14 05:50:40 user nova-compute[71312]:       </nova:ports>
Apr 14 05:50:40 user nova-compute[71312]:     </nova:instance>
Apr 14 05:50:40 user nova-compute[71312]:   </metadata>
Apr 14 05:50:40 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:50:40 user nova-compute[71312]:     <system>
Apr 14 05:50:40 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:50:40 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:50:40 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:50:40 user nova-compute[71312]:       <entry name="serial">5c09efbc-4c94-4130-a927-9239420b7d37</entry>
Apr 14 05:50:40 user nova-compute[71312]:       <entry name="uuid">5c09efbc-4c94-4130-a927-9239420b7d37</entry>
Apr 14 05:50:40 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:50:40 user nova-compute[71312]:     </system>
Apr 14 05:50:40 user nova-compute[71312]:   </sysinfo>
Apr 14 05:50:40 user nova-compute[71312]:   <os>
Apr 14 05:50:40 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:50:40 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:50:40 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:50:40 user nova-compute[71312]:   </os>
Apr 14 05:50:40 user nova-compute[71312]:   <features>
Apr 14 05:50:40 user nova-compute[71312]:     <acpi/>
Apr 14 05:50:40 user nova-compute[71312]:     <apic/>
Apr 14 05:50:40 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:50:40 user nova-compute[71312]:   </features>
Apr 14 05:50:40 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:50:40 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:50:40 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:50:40 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:50:40 user nova-compute[71312]:   </clock>
Apr 14 05:50:40 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:50:40 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:50:40 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:50:40 user nova-compute[71312]:   </cpu>
Apr 14 05:50:40 user nova-compute[71312]:   <devices>
Apr 14 05:50:40 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:50:40 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:50:40 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk"/>
Apr 14 05:50:40 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:50:40 user nova-compute[71312]:     </disk>
Apr 14 05:50:40 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:50:40 user nova-compute[71312]:       <mac address="fa:16:3e:db:0b:53"/>
Apr 14 05:50:40 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:40 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:50:40 user nova-compute[71312]:       <target dev="tap056b7c6a-6f"/>
Apr 14 05:50:40 user nova-compute[71312]:     </interface>
Apr 14 05:50:40 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:50:40 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/console.log" append="off"/>
Apr 14 05:50:40 user nova-compute[71312]:     </serial>
Apr 14 05:50:40 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:50:40 user nova-compute[71312]:     <video>
Apr 14 05:50:40 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:40 user nova-compute[71312]:     </video>
Apr 14 05:50:40 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:50:40 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:50:40 user nova-compute[71312]:     </rng>
Apr 14 05:50:40 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:50:40 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:50:40 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:50:40 user nova-compute[71312]:     </memballoon>
Apr 14 05:50:40 user nova-compute[71312]:   </devices>
Apr 14 05:50:40 user nova-compute[71312]: </domain>
Apr 14 05:50:40 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1574771686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1574771686',id=15,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-cvkivi41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:50:38Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=5c09efbc-4c94-4130-a927-9239420b7d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=056b7c6a-6fa1-4a4a-ba45-3084cfc33643,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056b7c6a-6f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG os_vif [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=056b7c6a-6fa1-4a4a-ba45-3084cfc33643,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056b7c6a-6f') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap056b7c6a-6f, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap056b7c6a-6f, col_values=(('external_ids', {'iface-id': '056b7c6a-6fa1-4a4a-ba45-3084cfc33643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:0b:53', 'vm-uuid': '5c09efbc-4c94-4130-a927-9239420b7d37'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:50:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:40 user nova-compute[71312]: INFO os_vif [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=056b7c6a-6fa1-4a4a-ba45-3084cfc33643,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056b7c6a-6f')
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No VIF found with MAC fa:16:3e:db:0b:53, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received event network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] No waiting events found dispatching network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:41 user nova-compute[71312]: WARNING nova.compute.manager [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received unexpected event network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 for instance with vm_state building and task_state spawning.
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451441.408028, 91db166d-7af7-4aa7-90bd-a003048effa5 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] VM Resumed (Lifecycle Event)
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:50:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Instance spawned successfully.
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:50:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451441.412582, 91db166d-7af7-4aa7-90bd-a003048effa5 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] VM Started (Lifecycle Event)
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updated VIF entry in instance network info cache for port 056b7c6a-6fa1-4a4a-ba45-3084cfc33643. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updating instance_info_cache with network_info: [{"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] Releasing lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:50:41 user nova-compute[71312]: INFO nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Took 7.67 seconds to spawn the instance on the hypervisor.
Apr 14 05:50:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:41 user nova-compute[71312]: INFO nova.compute.manager [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Took 8.87 seconds to build instance.
Apr 14 05:50:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.993s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received event network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] No waiting events found dispatching network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:42 user nova-compute[71312]: WARNING nova.compute.manager [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received unexpected event network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance with vm_state building and task_state spawning.
Apr 14 05:50:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received event network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] No waiting events found dispatching network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:45 user nova-compute[71312]: WARNING nova.compute.manager [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received unexpected event network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance with vm_state building and task_state spawning.
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451445.1941268, 5c09efbc-4c94-4130-a927-9239420b7d37 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] VM Resumed (Lifecycle Event)
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:50:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Instance spawned successfully.
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:50:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451445.1953607, 5c09efbc-4c94-4130-a927-9239420b7d37 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:50:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] VM Started (Lifecycle Event)
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:50:45 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:50:45 user nova-compute[71312]: INFO nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Took 7.45 seconds to spawn the instance on the hypervisor.
Apr 14 05:50:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:50:45 user nova-compute[71312]: INFO nova.compute.manager [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Took 8.32 seconds to build instance.
Apr 14 05:50:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "5c09efbc-4c94-4130-a927-9239420b7d37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.441s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:50:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:50:48 user nova-compute[71312]: INFO nova.compute.claims [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Claim successful on node user
Apr 14 05:50:49 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:50:49 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:50:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:50:49 user nova-compute[71312]: INFO nova.virt.block_device [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Booting with volume adbbc188-4e33-44fe-9723-30a4d276f9e7 at /dev/vda
Apr 14 05:50:49 user nova-compute[71312]: DEBUG nova.policy [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG os_brick.utils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936ba77-8834-46ea-b6d4-6a139de4ee06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f590e2ad-85fd-48f8-b0ee-3341df43d0c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1500c5b-d3f2-425d-8f18-9b9fa6020c5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba8cdf7-6c07-4ac5-9cdb-445c00824e87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:50:49 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:50:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b891ee07-5385-46ef-a7ad-54df1c1812df]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG os_brick.utils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:50:49 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Updating existing volume attachment record: 44ac3d2c-0649-4bdb-b389-8ea0eeb608c9 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:50:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Successfully created port: f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:50:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Successfully updated port: f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "refresh_cache-bf721faf-a8f3-42d6-a980-a49232e383d4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquired lock "refresh_cache-bf721faf-a8f3-42d6-a980-a49232e383d4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-changed-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Refreshing instance network info cache due to event network-changed-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] Acquiring lock "refresh_cache-bf721faf-a8f3-42d6-a980-a49232e383d4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:50:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:50:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Updating instance_info_cache with network_info: [{"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Releasing lock "refresh_cache-bf721faf-a8f3-42d6-a980-a49232e383d4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Instance network_info: |[{"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:50:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] Acquired lock "refresh_cache-bf721faf-a8f3-42d6-a980-a49232e383d4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:50:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Refreshing network info cache for port f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:50:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Updated VIF entry in instance network info cache for port f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:50:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Updating instance_info_cache with network_info: [{"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:50:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] Releasing lock "refresh_cache-bf721faf-a8f3-42d6-a980-a49232e383d4" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:50:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Creating image(s)
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Ensure instance console log exists: /opt/stack/data/nova/instances/bf721faf-a8f3-42d6-a980-a49232e383d4/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Start _get_guest_xml network_info=[{"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '44ac3d2c-0649-4bdb-b389-8ea0eeb608c9', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbageAzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf721faf-a8f3-42d6-a980-a49232e383d4', 'attached_at': '', 'detached_at': '', 'volume_id': 'adbbc188-4e33-44fe-9723-30a4d276f9e7', 'serial': 'adbbc188-4e33-44fe-9723-30a4d276f9e7'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:50:55 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:55 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbageAzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:50:55 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:50:55 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:50:55 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ba3034-3313-4b6c-ab2b-d0bac368157f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:50:55 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0bed9b-6e34-4a86-8553-0247dc87951f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7] added
Apr 14 05:50:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d6952-4c2d-4119-8fd6-ce101a67eddd]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1e2969-ee94-45ed-ac0f-fa5c532ac7bc]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbageAzT {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbageAzT" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12cb158-b76f-4f1a-ada6-d942633dd9de]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbageAzT'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66928f5b-17c5-489d-a2a2-b51270ad4d51]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb8b60d-44de-4dec-a319-67764662591d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:50:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:50:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eed5ea-0296-4a62-ad2d-20db30e53d6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7, portal: 172.16.0.220,3260]
Apr 14 05:50:55 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7, portal: 172.16.0.220,3260] successful.
Apr 14 05:50:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8090c599-df99-49ae-8df4-f05cdf017713]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a87ed8-170f-4c63-bd6a-87830cb7032a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:50:55 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:50:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:50:55 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:50:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda31aae-6b3e-4964-951f-c3eaaea05d45]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbageAzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:50:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23363636138653335', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363636138653335', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1002232884',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1002232884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1002232884',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-ut200gpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:50:50Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=bf721faf-a8f3-42d6-a980-a49232e383d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd1b88-04') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.objects.instance [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'pci_devices' on Instance uuid bf721faf-a8f3-42d6-a980-a49232e383d4 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:50:56 user nova-compute[71312]:   <uuid>bf721faf-a8f3-42d6-a980-a49232e383d4</uuid>
Apr 14 05:50:56 user nova-compute[71312]:   <name>instance-00000010</name>
Apr 14 05:50:56 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:50:56 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:50:56 user nova-compute[71312]:   <metadata>
Apr 14 05:50:56 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:50:56 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:50:56 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1002232884</nova:name>
Apr 14 05:50:56 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:50:55</nova:creationTime>
Apr 14 05:50:56 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:50:56 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:50:56 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:50:56 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:50:56 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:50:56 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:50:56 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:50:56 user nova-compute[71312]:       <nova:owner>
Apr 14 05:50:56 user nova-compute[71312]:         <nova:user uuid="670c42ab26ab49808773a20f14269e13">tempest-TestVolumeBootPattern-2132265128-project-member</nova:user>
Apr 14 05:50:56 user nova-compute[71312]:         <nova:project uuid="8134d4bfff8e465c8dc0a5342fee7e10">tempest-TestVolumeBootPattern-2132265128</nova:project>
Apr 14 05:50:56 user nova-compute[71312]:       </nova:owner>
Apr 14 05:50:56 user nova-compute[71312]:       <nova:ports>
Apr 14 05:50:56 user nova-compute[71312]:         <nova:port uuid="f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6">
Apr 14 05:50:56 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 05:50:56 user nova-compute[71312]:         </nova:port>
Apr 14 05:50:56 user nova-compute[71312]:       </nova:ports>
Apr 14 05:50:56 user nova-compute[71312]:     </nova:instance>
Apr 14 05:50:56 user nova-compute[71312]:   </metadata>
Apr 14 05:50:56 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:50:56 user nova-compute[71312]:     <system>
Apr 14 05:50:56 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:50:56 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:50:56 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:50:56 user nova-compute[71312]:       <entry name="serial">bf721faf-a8f3-42d6-a980-a49232e383d4</entry>
Apr 14 05:50:56 user nova-compute[71312]:       <entry name="uuid">bf721faf-a8f3-42d6-a980-a49232e383d4</entry>
Apr 14 05:50:56 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:50:56 user nova-compute[71312]:     </system>
Apr 14 05:50:56 user nova-compute[71312]:   </sysinfo>
Apr 14 05:50:56 user nova-compute[71312]:   <os>
Apr 14 05:50:56 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:50:56 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:50:56 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:50:56 user nova-compute[71312]:   </os>
Apr 14 05:50:56 user nova-compute[71312]:   <features>
Apr 14 05:50:56 user nova-compute[71312]:     <acpi/>
Apr 14 05:50:56 user nova-compute[71312]:     <apic/>
Apr 14 05:50:56 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:50:56 user nova-compute[71312]:   </features>
Apr 14 05:50:56 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:50:56 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:50:56 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:50:56 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:50:56 user nova-compute[71312]:   </clock>
Apr 14 05:50:56 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:50:56 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:50:56 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:50:56 user nova-compute[71312]:   </cpu>
Apr 14 05:50:56 user nova-compute[71312]:   <devices>
Apr 14 05:50:56 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:50:56 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:50:56 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Apr 14 05:50:56 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:50:56 user nova-compute[71312]:       <serial>adbbc188-4e33-44fe-9723-30a4d276f9e7</serial>
Apr 14 05:50:56 user nova-compute[71312]:     </disk>
Apr 14 05:50:56 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:50:56 user nova-compute[71312]:       <mac address="fa:16:3e:5d:0f:5d"/>
Apr 14 05:50:56 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:56 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:50:56 user nova-compute[71312]:       <target dev="tapf4bd1b88-04"/>
Apr 14 05:50:56 user nova-compute[71312]:     </interface>
Apr 14 05:50:56 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:50:56 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/bf721faf-a8f3-42d6-a980-a49232e383d4/console.log" append="off"/>
Apr 14 05:50:56 user nova-compute[71312]:     </serial>
Apr 14 05:50:56 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:50:56 user nova-compute[71312]:     <video>
Apr 14 05:50:56 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:50:56 user nova-compute[71312]:     </video>
Apr 14 05:50:56 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:50:56 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:50:56 user nova-compute[71312]:     </rng>
Apr 14 05:50:56 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:50:56 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:50:56 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:50:56 user nova-compute[71312]:     </memballoon>
Apr 14 05:50:56 user nova-compute[71312]:   </devices>
Apr 14 05:50:56 user nova-compute[71312]: </domain>
Apr 14 05:50:56 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1002232884',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1002232884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1002232884',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-ut200gpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:50:50Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=bf721faf-a8f3-42d6-a980-a49232e383d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd1b88-04') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG os_vif [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd1b88-04') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4bd1b88-04, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4bd1b88-04, col_values=(('external_ids', {'iface-id': 'f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:0f:5d', 'vm-uuid': 'bf721faf-a8f3-42d6-a980-a49232e383d4'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:56 user nova-compute[71312]: INFO os_vif [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd1b88-04')
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No VIF found with MAC fa:16:3e:5d:0f:5d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:50:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] No waiting events found dispatching network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:50:58 user nova-compute[71312]: WARNING nova.compute.manager [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received unexpected event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance with vm_state building and task_state spawning.
Apr 14 05:50:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:50:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451460.2461345, bf721faf-a8f3-42d6-a980-a49232e383d4 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:51:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] VM Resumed (Lifecycle Event)
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:51:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Instance spawned successfully.
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:51:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451460.2498312, bf721faf-a8f3-42d6-a980-a49232e383d4 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:51:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] VM Started (Lifecycle Event)
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] No waiting events found dispatching network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:51:00 user nova-compute[71312]: WARNING nova.compute.manager [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received unexpected event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance with vm_state building and task_state spawning.
Apr 14 05:51:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:51:00 user nova-compute[71312]: INFO nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Took 5.38 seconds to spawn the instance on the hypervisor.
Apr 14 05:51:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:00 user nova-compute[71312]: INFO nova.compute.manager [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Took 11.63 seconds to build instance.
Apr 14 05:51:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.768s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:51:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:07 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:51:07 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=26.40045928955078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 91db166d-7af7-4aa7-90bd-a003048effa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance bf721faf-a8f3-42d6-a980-a49232e383d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:51:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 05:51:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:51:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:51:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:51:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:51:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:51:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:51:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:51:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:51:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:51:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-changed-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Refreshing instance network info cache due to event network-changed-afbb14f2-3ce8-4993-b4cb-40e2c9567067. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:51:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] Acquiring lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:51:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] Acquired lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:51:18 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Refreshing network info cache for port afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updated VIF entry in instance network info cache for port afbb14f2-3ce8-4993-b4cb-40e2c9567067. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating instance_info_cache with network_info: [{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] Releasing lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "88eea6fd-6dde-4692-891e-0587ae62d90c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:51:19 user nova-compute[71312]: INFO nova.compute.claims [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Claim successful on node user
Apr 14 05:51:19 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:51:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:51:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Creating image(s)
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "/opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "/opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "/opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.policy [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk 1073741824" returned: 0 in 0.049s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Cannot resize image /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lazy-loading 'migration_context' on Instance uuid 88eea6fd-6dde-4692-891e-0587ae62d90c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Ensure instance console log exists: /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:21 user nova-compute[71312]: INFO nova.compute.manager [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Attaching volume e5633694-9b3e-4f90-af91-b14d5be70916 to /dev/vdb
Apr 14 05:51:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Successfully created port: 0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG os_brick.utils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1021d-3cc7-42d5-a1ff-d3d012c789cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95811b96-6c6b-4bcd-93bc-9dc178a2eb75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1487a0-5ddb-44e4-91f7-d03496a526cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d97c9b-adfc-41cc-a09b-cdf4c2010985]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:51:21 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:51:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c48b9-5a7c-4a7a-be54-85e164a78bc7]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG os_brick.utils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating existing volume attachment record: 2f498b76-da3f-4b5e-9390-6c62ba63988b {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Successfully updated port: 0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquired lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received event network-changed-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Refreshing instance network info cache due to event network-changed-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] Acquiring lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Updating instance_info_cache with network_info: [{"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Releasing lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Instance network_info: |[{"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] Acquired lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Refreshing network info cache for port 0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Start _get_guest_xml network_info=[{"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:51:22 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:51:22 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1248527205',display_name='tempest-ServersNegativeTestJSON-server-1248527205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1248527205',id=17,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='289cfed4776048b18eca85457a194bfb',ramdisk_id='',reservation_id='r-0lrt044b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1687375833',owner_user_name='tempest-ServersNegativeTestJSON-1687375833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:51:20Z,user_data=None,user_id='4e56c03cd09f4a3882e8dffbbaa40c97',uuid=88eea6fd-6dde-4692-891e-0587ae62d90c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converting VIF {"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8d:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab07a22-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lazy-loading 'pci_devices' on Instance uuid 88eea6fd-6dde-4692-891e-0587ae62d90c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:51:22 user nova-compute[71312]:   <uuid>88eea6fd-6dde-4692-891e-0587ae62d90c</uuid>
Apr 14 05:51:22 user nova-compute[71312]:   <name>instance-00000011</name>
Apr 14 05:51:22 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:51:22 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:51:22 user nova-compute[71312]:   <metadata>
Apr 14 05:51:22 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:51:22 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:51:22 user nova-compute[71312]:       <nova:name>tempest-ServersNegativeTestJSON-server-1248527205</nova:name>
Apr 14 05:51:22 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:51:22</nova:creationTime>
Apr 14 05:51:22 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:51:22 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:51:22 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:51:22 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:51:22 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:51:22 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:51:22 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:51:22 user nova-compute[71312]:       <nova:owner>
Apr 14 05:51:22 user nova-compute[71312]:         <nova:user uuid="4e56c03cd09f4a3882e8dffbbaa40c97">tempest-ServersNegativeTestJSON-1687375833-project-member</nova:user>
Apr 14 05:51:22 user nova-compute[71312]:         <nova:project uuid="289cfed4776048b18eca85457a194bfb">tempest-ServersNegativeTestJSON-1687375833</nova:project>
Apr 14 05:51:22 user nova-compute[71312]:       </nova:owner>
Apr 14 05:51:22 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:51:22 user nova-compute[71312]:       <nova:ports>
Apr 14 05:51:22 user nova-compute[71312]:         <nova:port uuid="0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8">
Apr 14 05:51:22 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 05:51:22 user nova-compute[71312]:         </nova:port>
Apr 14 05:51:22 user nova-compute[71312]:       </nova:ports>
Apr 14 05:51:22 user nova-compute[71312]:     </nova:instance>
Apr 14 05:51:22 user nova-compute[71312]:   </metadata>
Apr 14 05:51:22 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:51:22 user nova-compute[71312]:     <system>
Apr 14 05:51:22 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:51:22 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:51:22 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:51:22 user nova-compute[71312]:       <entry name="serial">88eea6fd-6dde-4692-891e-0587ae62d90c</entry>
Apr 14 05:51:22 user nova-compute[71312]:       <entry name="uuid">88eea6fd-6dde-4692-891e-0587ae62d90c</entry>
Apr 14 05:51:22 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:51:22 user nova-compute[71312]:     </system>
Apr 14 05:51:22 user nova-compute[71312]:   </sysinfo>
Apr 14 05:51:22 user nova-compute[71312]:   <os>
Apr 14 05:51:22 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:51:22 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:51:22 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:51:22 user nova-compute[71312]:   </os>
Apr 14 05:51:22 user nova-compute[71312]:   <features>
Apr 14 05:51:22 user nova-compute[71312]:     <acpi/>
Apr 14 05:51:22 user nova-compute[71312]:     <apic/>
Apr 14 05:51:22 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:51:22 user nova-compute[71312]:   </features>
Apr 14 05:51:22 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:51:22 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:51:22 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:51:22 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:51:22 user nova-compute[71312]:   </clock>
Apr 14 05:51:22 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:51:22 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:51:22 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:51:22 user nova-compute[71312]:   </cpu>
Apr 14 05:51:22 user nova-compute[71312]:   <devices>
Apr 14 05:51:22 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:51:22 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:51:22 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk"/>
Apr 14 05:51:22 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:51:22 user nova-compute[71312]:     </disk>
Apr 14 05:51:22 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:51:22 user nova-compute[71312]:       <mac address="fa:16:3e:75:8d:d2"/>
Apr 14 05:51:22 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:51:22 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:51:22 user nova-compute[71312]:       <target dev="tap0ab07a22-05"/>
Apr 14 05:51:22 user nova-compute[71312]:     </interface>
Apr 14 05:51:22 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:51:22 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/console.log" append="off"/>
Apr 14 05:51:22 user nova-compute[71312]:     </serial>
Apr 14 05:51:22 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:51:22 user nova-compute[71312]:     <video>
Apr 14 05:51:22 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:51:22 user nova-compute[71312]:     </video>
Apr 14 05:51:22 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:51:22 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:51:22 user nova-compute[71312]:     </rng>
Apr 14 05:51:22 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:51:22 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:51:22 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:51:22 user nova-compute[71312]:     </memballoon>
Apr 14 05:51:22 user nova-compute[71312]:   </devices>
Apr 14 05:51:22 user nova-compute[71312]: </domain>
Apr 14 05:51:22 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1248527205',display_name='tempest-ServersNegativeTestJSON-server-1248527205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1248527205',id=17,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='289cfed4776048b18eca85457a194bfb',ramdisk_id='',reservation_id='r-0lrt044b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1687375833',owner_user_name='tempest-ServersNegativeTestJSON-1687375833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:51:20Z,user_data=None,user_id='4e56c03cd09f4a3882e8dffbbaa40c97',uuid=88eea6fd-6dde-4692-891e-0587ae62d90c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converting VIF {"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:8d:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab07a22-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG os_vif [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8d:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab07a22-05') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ab07a22-05, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ab07a22-05, col_values=(('external_ids', {'iface-id': '0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:8d:d2', 'vm-uuid': '88eea6fd-6dde-4692-891e-0587ae62d90c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:22 user nova-compute[71312]: INFO os_vif [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:8d:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab07a22-05')
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:51:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] No VIF found with MAC fa:16:3e:75:8d:d2, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:51:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Updated VIF entry in instance network info cache for port 0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:51:23 user nova-compute[71312]: DEBUG nova.network.neutron [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Updating instance_info_cache with network_info: [{"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:51:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] Releasing lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received event network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] Acquiring lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] No waiting events found dispatching network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:51:24 user nova-compute[71312]: WARNING nova.compute.manager [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received unexpected event network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance with vm_state building and task_state spawning.
Apr 14 05:51:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FReWMhZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:51:26 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:51:26 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:51:26 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fbf334-4fd1-4c6a-93f4-a3e4dd775564]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:51:26 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6b936a-4e48-4812-ac88-c4c415b0c310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916] added
Apr 14 05:51:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[40030990-1532-44a7-9e6e-3c3bf46a2f7d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0b46a5-c2a1-4f56-8e19-898f06414822]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FReWMhZw {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FReWMhZw" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4800e294-fbdd-4bdd-807a-f331d575c57e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FReWMhZw'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb95eef2-3f26-4537-b0fe-57cc22e89bcb]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451486.3978767, 88eea6fd-6dde-4692-891e-0587ae62d90c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:51:26 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] VM Resumed (Lifecycle Event)
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:51:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Instance spawned successfully.
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e506928-453a-4672-b617-c4ed421c995f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:51:26 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:51:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:51:26 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:51:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa961d7-e870-4046-ba93-d21cbae73853]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260]
Apr 14 05:51:26 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260] successful.
Apr 14 05:51:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451486.3984752, 88eea6fd-6dde-4692-891e-0587ae62d90c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:51:26 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] VM Started (Lifecycle Event)
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da407c1a-4532-4243-b651-85944fbbe622]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: INFO nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Took 6.35 seconds to spawn the instance on the hypervisor.
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a10447-bb23-41cf-acbd-b786e23f3bed]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:51:26 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:51:26 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:51:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:51:26 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:51:26 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:51:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:51:26 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c540b057-bb02-4e99-9ab7-a0e50d0651f6]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:51:26 user nova-compute[71312]: INFO nova.compute.manager [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Took 7.07 seconds to build instance.
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.171s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received event network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] Acquiring lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] No waiting events found dispatching network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:51:26 user nova-compute[71312]: WARNING nova.compute.manager [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received unexpected event network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance with vm_state active and task_state None.
Apr 14 05:51:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:51:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FReWMhZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:51:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:51:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23432623235383265', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:51:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432623235383265', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:51:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:51:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:51:27 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:51:27 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 05:51:27 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:51:27 user nova-compute[71312]:   <serial>e5633694-9b3e-4f90-af91-b14d5be70916</serial>
Apr 14 05:51:27 user nova-compute[71312]: </disk>
Apr 14 05:51:27 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:51:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:51:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:51:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No VIF found with MAC fa:16:3e:4c:94:55, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:51:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.812s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71312) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:51:29 user nova-compute[71312]: WARNING nova.compute.manager [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state active and task_state powering-off.
Apr 14 05:51:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance destroyed successfully.
Apr 14 05:51:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.931s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:51:31 user nova-compute[71312]: WARNING nova.compute.manager [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state stopped and task_state None.
Apr 14 05:51:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:35 user nova-compute[71312]: INFO nova.compute.manager [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Terminating instance
Apr 14 05:51:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received event network-vif-unplugged-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] Acquiring lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] No waiting events found dispatching network-vif-unplugged-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received event network-vif-unplugged-0ceea987-cfef-4579-a50d-2a53ef497efa for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:51:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Instance destroyed successfully.
Apr 14 05:51:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'resources' on Instance uuid b4a09d25-305a-4c5f-96db-e5b07dfaa494 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-962541278',display_name='tempest-VolumesAdminNegativeTest-server-962541278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-962541278',id=12,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0538df9180154c65a4405779a49914b3',ramdisk_id='',reservation_id='r-2gqhbq4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-881296749',owner_user_name='tempest-VolumesAdminNegativeTest-881296749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:49:46Z,user_data=None,user_id='9c0ba3adada84bb0975af922caaaa2bc',uuid=b4a09d25-305a-4c5f-96db-e5b07dfaa494,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converting VIF {"id": "0ceea987-cfef-4579-a50d-2a53ef497efa", "address": "fa:16:3e:14:b8:91", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ceea987-cf", "ovs_interfaceid": "0ceea987-cfef-4579-a50d-2a53ef497efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b8:91,bridge_name='br-int',has_traffic_filtering=True,id=0ceea987-cfef-4579-a50d-2a53ef497efa,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ceea987-cf') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG os_vif [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b8:91,bridge_name='br-int',has_traffic_filtering=True,id=0ceea987-cfef-4579-a50d-2a53ef497efa,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ceea987-cf') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ceea987-cf, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:51:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:35 user nova-compute[71312]: INFO os_vif [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b8:91,bridge_name='br-int',has_traffic_filtering=True,id=0ceea987-cfef-4579-a50d-2a53ef497efa,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ceea987-cf')
Apr 14 05:51:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Deleting instance files /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494_del
Apr 14 05:51:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Deletion of /opt/stack/data/nova/instances/b4a09d25-305a-4c5f-96db-e5b07dfaa494_del complete
Apr 14 05:51:36 user nova-compute[71312]: INFO nova.compute.manager [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Took 0.99 seconds to destroy the instance on the hypervisor.
Apr 14 05:51:36 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:51:36 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Took 0.58 seconds to deallocate network for instance.
Apr 14 05:51:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-f61829cc-a119-4b20-82c7-cd1e4dc66478 req-89080625-3373-419e-aee0-214575f5dc9d service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received event network-vif-deleted-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:51:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:36 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Deleted allocations for instance b4a09d25-305a-4c5f-96db-e5b07dfaa494
Apr 14 05:51:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.071s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received event network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:51:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] Acquiring lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:51:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:51:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] Lock "b4a09d25-305a-4c5f-96db-e5b07dfaa494-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:51:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] No waiting events found dispatching network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:51:37 user nova-compute[71312]: WARNING nova.compute.manager [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Received unexpected event network-vif-plugged-0ceea987-cfef-4579-a50d-2a53ef497efa for instance with vm_state deleted and task_state None.
Apr 14 05:51:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:44 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451489.9636467, 8bc9e54a-dc25-421f-a380-a394b0867000 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:51:44 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Stopped (Lifecycle Event)
Apr 14 05:51:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8f73ad00-9fb7-4d41-8a7b-97d2bc5c27d1 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8f73ad00-9fb7-4d41-8a7b-97d2bc5c27d1 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:51:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:50 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451495.8896801, b4a09d25-305a-4c5f-96db-e5b07dfaa494 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:51:50 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] VM Stopped (Lifecycle Event)
Apr 14 05:51:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7db9610-06d3-402f-9ffc-7f07f91f52cc None None] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:51:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:51:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-changed-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Refreshing instance network info cache due to event network-changed-2d2429bd-952a-41bd-8807-48328561c775. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:52:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] Acquiring lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] Acquired lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Refreshing network info cache for port 2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:52:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updated VIF entry in instance network info cache for port 2d2429bd-952a-41bd-8807-48328561c775. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:52:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] Releasing lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:03 user nova-compute[71312]: INFO nova.compute.manager [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Shelving
Apr 14 05:52:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-unplugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] No waiting events found dispatching network-vif-unplugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:03 user nova-compute[71312]: WARNING nova.compute.manager [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received unexpected event network-vif-unplugged-2d2429bd-952a-41bd-8807-48328561c775 for instance with vm_state active and task_state shelving.
Apr 14 05:52:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance destroyed successfully.
Apr 14 05:52:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Beginning cold snapshot process
Apr 14 05:52:04 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk /opt/stack/data/nova/instances/snapshots/tmp0mqyt5yc/1158eec03b2c4154b3f66493c160943b {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:52:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk /opt/stack/data/nova/instances/snapshots/tmp0mqyt5yc/1158eec03b2c4154b3f66493c160943b" returned: 0 in 0.608s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Snapshot extracted, beginning image upload
Apr 14 05:52:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] No waiting events found dispatching network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:05 user nova-compute[71312]: WARNING nova.compute.manager [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received unexpected event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:06 user nova-compute[71312]: INFO nova.compute.manager [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Unrescuing
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'flavor' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Snapshot image upload complete
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:07 user nova-compute[71312]: INFO nova.compute.manager [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Shelve offloading
Apr 14 05:52:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance destroyed successfully.
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquired lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:07 user nova-compute[71312]: WARNING nova.compute.manager [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-changed-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Refreshing instance network info cache due to event network-changed-b5de51fa-6654-4f76-89df-063a4d6ad4f0. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Refreshing network info cache for port b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:52:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance destroyed successfully.
Apr 14 05:52:07 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:52:07 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:52:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7972MB free_disk=26.341869354248047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 91db166d-7af7-4aa7-90bd-a003048effa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance bf721faf-a8f3-42d6-a980-a49232e383d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 88eea6fd-6dde-4692-891e-0587ae62d90c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updated VIF entry in instance network info cache for port b5de51fa-6654-4f76-89df-063a4d6ad4f0. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Releasing lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:52:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance destroyed successfully.
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'resources' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-553121458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-553121458',id=13,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPD8RR/MXsr73U6E444PVtrgNrPdCCTH4RWjomjXjHxW2wSulD9GhjzDqJBH1L2kZm8JKbhhDzZOX+USbsm/JWzQtiZMhfScVGIoyCJ/BXIUdnRB7W6UoB0Q8LgoWJaYQ==',key_name='tempest-keypair-1417329181',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:50:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-27lzq4z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member',shelved_at='2023-04-14T05:52:07.266191',shelved_host='user',shelved_image_id='e759324f-c97e-4c98-a662-32ce6a697745'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=87153a66-bf2c-45f5-aa66-c94eaa6ea7ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG os_vif [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d2429bd-95, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-changed-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Refreshing instance network info cache due to event network-changed-2d2429bd-952a-41bd-8807-48328561c775. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] Acquiring lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] Acquired lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Refreshing network info cache for port 2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: INFO os_vif [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95')
Apr 14 05:52:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Deleting instance files /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea_del
Apr 14 05:52:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Deletion of /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea_del complete
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updating instance_info_cache with network_info: [{"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-932e9aba-ecce-4d2e-8486-eb2e3c685403" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 05:52:09 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Deleted allocations for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'numa_topology' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:09 user nova-compute[71312]: WARNING nova.compute.manager [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:09 user nova-compute[71312]: WARNING nova.compute.manager [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-changed-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Refreshing instance network info cache due to event network-changed-b5de51fa-6654-4f76-89df-063a4d6ad4f0. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] Acquiring lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] Acquired lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Refreshing network info cache for port b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updated VIF entry in instance network info cache for port 2d2429bd-952a-41bd-8807-48328561c775. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2d2429bd-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] Releasing lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.665s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updated VIF entry in instance network info cache for port b5de51fa-6654-4f76-89df-063a4d6ad4f0. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:52:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [{"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] Releasing lock "refresh_cache-4a200376-4747-49ed-96d4-3fe9ac338dcc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 4a200376-4747-49ed-96d4-3fe9ac338dcc due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451531.554449, 4a200376-4747-49ed-96d4-3fe9ac338dcc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:52:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] VM Resumed (Lifecycle Event)
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:52:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451531.5570552, 4a200376-4747-49ed-96d4-3fe9ac338dcc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:52:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] VM Started (Lifecycle Event)
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:11 user nova-compute[71312]: WARNING nova.compute.manager [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state active and task_state None.
Apr 14 05:52:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:19 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451524.0279853, 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:52:19 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] VM Stopped (Lifecycle Event)
Apr 14 05:52:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-870f0621-8a8d-49cd-a572-637f176c2f03 None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'flavor' on Instance uuid 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Ignoring supplied device name: /dev/vdb
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:23 user nova-compute[71312]: INFO nova.compute.manager [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Attaching volume 79faff7e-a8ce-491e-843c-27e2a905be1a to /dev/vdb
Apr 14 05:52:23 user nova-compute[71312]: DEBUG os_brick.utils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae08a5e9-9432-41d9-ab9b-a616afdf79d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f56dfe-145d-4e65-ac80-4f49af972e91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ff1d1b-e449-43f9-8880-5ec7264fc83f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c187d2e-262c-4732-b81c-c515929f3702]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:52:23 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:52:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8cef72-d3fe-48f2-a21f-ec312d1b3b77]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG os_brick.utils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:52:23 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Updating existing volume attachment record: fa1d6f06-09ad-4325-994e-4d3c85d6b943 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:52:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:25 user nova-compute[71312]: INFO nova.compute.manager [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Detaching volume 1ef50ac6-649b-4f1e-a49a-38c762ee04ad
Apr 14 05:52:25 user nova-compute[71312]: INFO nova.virt.block_device [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Attempting to driver detach volume 1ef50ac6-649b-4f1e-a49a-38c762ee04ad from mountpoint /dev/vdb
Apr 14 05:52:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Attempting to detach device vdb from instance 4a200376-4747-49ed-96d4-3fe9ac338dcc from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:52:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:52:25 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:52:25 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:52:25 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:52:25 user nova-compute[71312]:   <serial>1ef50ac6-649b-4f1e-a49a-38c762ee04ad</serial>
Apr 14 05:52:25 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:52:25 user nova-compute[71312]: </disk>
Apr 14 05:52:25 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:52:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Successfully detached device vdb from instance 4a200376-4747-49ed-96d4-3fe9ac338dcc from the persistent domain config.
Apr 14 05:52:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a200376-4747-49ed-96d4-3fe9ac338dcc from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:52:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:52:25 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:52:25 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:52:25 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:52:25 user nova-compute[71312]:   <serial>1ef50ac6-649b-4f1e-a49a-38c762ee04ad</serial>
Apr 14 05:52:25 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:52:25 user nova-compute[71312]: </disk>
Apr 14 05:52:25 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451546.4399984, 4a200376-4747-49ed-96d4-3fe9ac338dcc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:52:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Successfully detached device vdb from instance 4a200376-4747-49ed-96d4-3fe9ac338dcc from the live domain config.
Apr 14 05:52:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deiAzlaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:52:26 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdeca2c-2865-4ab7-900c-07704926e1f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:52:26 user nova-compute[71312]: No targets found.
Apr 14 05:52:26 user nova-compute[71312]: iSNS:
Apr 14 05:52:26 user nova-compute[71312]: No targets found.
Apr 14 05:52:26 user nova-compute[71312]: STATIC:
Apr 14 05:52:26 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916
Apr 14 05:52:26 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:52:26 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:52:26 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad
Apr 14 05:52:26 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:52:26 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:52:26 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7
Apr 14 05:52:26 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:52:26 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:52:26 user nova-compute[71312]: FIRMWARE:
Apr 14 05:52:26 user nova-compute[71312]: No targets found.
Apr 14 05:52:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:52:26 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:52:26 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[213768d6-61bf-4bf7-befe-16b77584dd25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fe3fb3-7296-4966-9efa-e9b389e943c0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:52:26 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:26 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad (non-flash)
Apr 14 05:52:26 user nova-compute[71312]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:26 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c41a2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68766b7-62b6-4630-941f-1ab6182e4071]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[339bc163-b712-4939-bdd9-fa8d623e2b13]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b1b5cb-0498-42a8-9d84-542aed40f7d7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0268447c-cc12-41b3-a6ab-0e7c30d991db]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[15758e03-08a9-4580-bdf7-f4683f8eda70]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f11ab68-54c8-406a-aef6-59b1bafaf1e2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad, portal: 172.16.0.220,3260]
Apr 14 05:52:26 user nova-compute[71312]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad, portal: 172.16.0.220,3260] successful.
Apr 14 05:52:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ef50ac6-649b-4f1e-a49a-38c762ee04ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8107f9-d6d6-4af5-b832-d888101fd1df]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] <== disconnect_volume: return (309ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:52:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:52:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'flavor' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.787s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:28 user nova-compute[71312]: INFO nova.compute.manager [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] instance snapshotting
Apr 14 05:52:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Beginning live snapshot process
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYNzaulP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:52:28 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:52:28 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:52:28 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bea66a3-834d-4268-9b2c-2d729bf36b2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:52:28 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[97df5293-b03a-4b33-a44f-b81224ece529]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a] added
Apr 14 05:52:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json -f qcow2" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e8ca03-a872-4c73-8ed0-f2d19db48ae8]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e714c32-b982-499d-93ab-817b3e718c48]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYNzaulP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYNzaulP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ba5027-b363-48b6-9a90-9387a94955f1]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QYNzaulP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7514531f-a8ba-4adb-afd5-cc70e00ca066]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acf0e42-5964-4ac9-a914-f0d1954e9d2b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:28 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:28 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e123e0b5-5765-417b-9dfc-14b1eb836e4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a, portal: 172.16.0.220,3260]
Apr 14 05:52:28 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a, portal: 172.16.0.220,3260] successful.
Apr 14 05:52:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d56746f-2a2f-4df8-b28f-bc4f69dca298]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe78032-3f92-4685-b5a9-f67351b36b86]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:28 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:28 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a (non-flash)
Apr 14 05:52:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:28 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:28 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a (non-flash)
Apr 14 05:52:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbc3166-fed2-42c1-8f60-ae3c01fade1a]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYNzaulP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsrjq6itu/6fa003e7a89c4bfaa45e69674cae3af1.delta 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsrjq6itu/6fa003e7a89c4bfaa45e69674cae3af1.delta 1073741824" returned: 0 in 0.057s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 05:52:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:29 user nova-compute[71312]: INFO nova.compute.manager [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Terminating instance
Apr 14 05:52:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received event network-vif-unplugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] No waiting events found dispatching network-vif-unplugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received event network-vif-unplugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23465316561646461', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465316561646461', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'flavor' on Instance uuid 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:52:29 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:52:29 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:52:29 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:52:29 user nova-compute[71312]:   <serial>79faff7e-a8ce-491e-843c-27e2a905be1a</serial>
Apr 14 05:52:29 user nova-compute[71312]: </disk>
Apr 14 05:52:29 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 05:52:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 05:52:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Instance destroyed successfully.
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'resources' on Instance uuid 932e9aba-ecce-4d2e-8486-eb2e3c685403 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-842887210',display_name='tempest-VolumesAdminNegativeTest-server-842887210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-842887210',id=3,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHubLnlaLGM24dmTAWf3L1Fc2fGI319C8qFPlbCxf8okKWTBrEwOsXZzfNL2S1nurfN2NJCKG/bNFXdy2Gc8G9HK7xV+4Myzrst68DbfnEuIFN/ifyU3RjdUwb5AlTrrBA==',key_name='tempest-keypair-1347509802',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0538df9180154c65a4405779a49914b3',ramdisk_id='',reservation_id='r-87a1x0ss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-881296749',owner_user_name='tempest-VolumesAdminNegativeTest-881296749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c0ba3adada84bb0975af922caaaa2bc',uuid=932e9aba-ecce-4d2e-8486-eb2e3c685403,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converting VIF {"id": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "address": "fa:16:3e:26:b9:59", "network": {"id": "706e7dfb-b047-4c7c-921f-5e7cac4901df", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-286752937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0538df9180154c65a4405779a49914b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9abbeea-53", "ovs_interfaceid": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=a9abbeea-538e-4cf6-96b0-71fdeec1f2c3,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9abbeea-53') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG os_vif [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=a9abbeea-538e-4cf6-96b0-71fdeec1f2c3,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9abbeea-53') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsrjq6itu/6fa003e7a89c4bfaa45e69674cae3af1.delta /opt/stack/data/nova/instances/snapshots/tmpsrjq6itu/6fa003e7a89c4bfaa45e69674cae3af1 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9abbeea-53, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No VIF found with MAC fa:16:3e:bd:82:1a, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:30 user nova-compute[71312]: INFO os_vif [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=a9abbeea-538e-4cf6-96b0-71fdeec1f2c3,network=Network(706e7dfb-b047-4c7c-921f-5e7cac4901df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9abbeea-53')
Apr 14 05:52:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Deleting instance files /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403_del
Apr 14 05:52:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Deletion of /opt/stack/data/nova/instances/932e9aba-ecce-4d2e-8486-eb2e3c685403_del complete
Apr 14 05:52:30 user nova-compute[71312]: INFO nova.compute.manager [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Took 1.38 seconds to destroy the instance on the hypervisor.
Apr 14 05:52:30 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:52:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsrjq6itu/6fa003e7a89c4bfaa45e69674cae3af1.delta /opt/stack/data/nova/instances/snapshots/tmpsrjq6itu/6fa003e7a89c4bfaa45e69674cae3af1" returned: 0 in 0.232s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Snapshot extracted, beginning image upload
Apr 14 05:52:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.167s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received event network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] Acquiring lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] No waiting events found dispatching network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:31 user nova-compute[71312]: WARNING nova.compute.manager [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received unexpected event network-vif-plugged-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance with vm_state active and task_state deleting.
Apr 14 05:52:31 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:31 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Took 1.08 seconds to deallocate network for instance.
Apr 14 05:52:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 05:52:32 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:52:32 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:52:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:32 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Deleted allocations for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403
Apr 14 05:52:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "932e9aba-ecce-4d2e-8486-eb2e3c685403" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.119s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:33 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Snapshot image upload complete
Apr 14 05:52:33 user nova-compute[71312]: INFO nova.compute.manager [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Took 5.12 seconds to snapshot the instance on the hypervisor.
Apr 14 05:52:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-4d75c875-8788-4df2-af67-35efac456763 req-9cee073d-facf-4bd5-9f37-8fafdc8c4e12 service nova] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Received event network-vif-deleted-a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:52:43 user nova-compute[71312]: INFO nova.compute.claims [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Claim successful on node user
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:52:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:52:43 user nova-compute[71312]: INFO nova.virt.block_device [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Booting with volume snapshot 388333c3-8208-4f69-88de-a8d33c7d4527 at /dev/vda
Apr 14 05:52:43 user nova-compute[71312]: DEBUG nova.policy [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Successfully created port: 6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:52:44 user nova-compute[71312]: WARNING nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Apr 14 05:52:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 5c09efbc-4c94-4130-a927-9239420b7d37 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid bf721faf-a8f3-42d6-a980-a49232e383d4 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 88eea6fd-6dde-4692-891e-0587ae62d90c {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "5c09efbc-4c94-4130-a927-9239420b7d37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "88eea6fd-6dde-4692-891e-0587ae62d90c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "5c09efbc-4c94-4130-a927-9239420b7d37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451550.2709997, 932e9aba-ecce-4d2e-8486-eb2e3c685403 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:52:45 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] VM Stopped (Lifecycle Event)
Apr 14 05:52:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4fb0556c-a952-44be-8841-4a37d7d5a242 None None] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Successfully updated port: 6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "refresh_cache-4b2a98a9-3b3c-4e54-924e-47a5c69b1266" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquired lock "refresh_cache-4b2a98a9-3b3c-4e54-924e-47a5c69b1266" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received event network-changed-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Refreshing instance network info cache due to event network-changed-6c275402-2e94-4f9d-86ec-e0c921f8c0cf. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] Acquiring lock "refresh_cache-4b2a98a9-3b3c-4e54-924e-47a5c69b1266" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:52:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Updating instance_info_cache with network_info: [{"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Releasing lock "refresh_cache-4b2a98a9-3b3c-4e54-924e-47a5c69b1266" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Instance network_info: |[{"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:52:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] Acquired lock "refresh_cache-4b2a98a9-3b3c-4e54-924e-47a5c69b1266" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:52:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Refreshing network info cache for port 6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:52:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Updated VIF entry in instance network info cache for port 6c275402-2e94-4f9d-86ec-e0c921f8c0cf. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:52:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Updating instance_info_cache with network_info: [{"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] Releasing lock "refresh_cache-4b2a98a9-3b3c-4e54-924e-47a5c69b1266" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG os_brick.utils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93fa687-f3fb-4a06-8417-3e8eb23e4fa4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc42635-5f7b-4380-a859-5be215427530]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40ab410-18d8-43f2-bf10-d05a08c005ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc218df-ab37-45e0-a486-795726e66bd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:52:49 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:52:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04f02de-fce7-407b-8f3f-63f48ff3b5ad]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG os_brick.utils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:52:49 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Updating existing volume attachment record: e4cfd119-13d2-4e5c-ad8e-5af329c14303 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:52:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:50 user nova-compute[71312]: INFO nova.compute.manager [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Detaching volume 79faff7e-a8ce-491e-843c-27e2a905be1a
Apr 14 05:52:50 user nova-compute[71312]: INFO nova.virt.block_device [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Attempting to driver detach volume 79faff7e-a8ce-491e-843c-27e2a905be1a from mountpoint /dev/vdb
Apr 14 05:52:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Attempting to detach device vdb from instance 91db166d-7af7-4aa7-90bd-a003048effa5 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:52:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:52:50 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:52:50 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:52:50 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:52:50 user nova-compute[71312]:   <serial>79faff7e-a8ce-491e-843c-27e2a905be1a</serial>
Apr 14 05:52:50 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:52:50 user nova-compute[71312]: </disk>
Apr 14 05:52:50 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:52:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Successfully detached device vdb from instance 91db166d-7af7-4aa7-90bd-a003048effa5 from the persistent domain config.
Apr 14 05:52:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91db166d-7af7-4aa7-90bd-a003048effa5 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:52:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:52:50 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:52:50 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:52:50 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:52:50 user nova-compute[71312]:   <serial>79faff7e-a8ce-491e-843c-27e2a905be1a</serial>
Apr 14 05:52:50 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:52:50 user nova-compute[71312]: </disk>
Apr 14 05:52:50 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:52:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451571.2871716, 91db166d-7af7-4aa7-90bd-a003048effa5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:52:51 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Successfully detached device vdb from instance 91db166d-7af7-4aa7-90bd-a003048effa5 from the live domain config.
Apr 14 05:52:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYNzaulP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:52:51 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a104786-c294-46f8-9148-6851ee410973]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:52:51 user nova-compute[71312]: No targets found.
Apr 14 05:52:51 user nova-compute[71312]: iSNS:
Apr 14 05:52:51 user nova-compute[71312]: No targets found.
Apr 14 05:52:51 user nova-compute[71312]: STATIC:
Apr 14 05:52:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916
Apr 14 05:52:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:52:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:52:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7
Apr 14 05:52:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:52:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:52:51 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a
Apr 14 05:52:51 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:52:51 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:52:51 user nova-compute[71312]: FIRMWARE:
Apr 14 05:52:51 user nova-compute[71312]: No targets found.
Apr 14 05:52:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:52:51 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:52:51 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac00d5d-ef76-400c-901c-07460fbd5564]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce6629-6eb1-48fc-8716-45e882d7cf0b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:51 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:51 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a (non-flash)
Apr 14 05:52:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:51 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:51 user nova-compute[71312]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a (non-flash)
Apr 14 05:52:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49a4539ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e60591-4123-495d-9c60-9ae4d50ab06d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3d9fe2-40f4-4383-9acd-a2dc087d0902]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc909d46-6666-438f-893c-0c97e8f67c51]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d624380c-20d8-4ff9-a5c1-8f326746de3b]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1f1334-4fa8-4e1a-afe6-f32972273f0c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1c7cc2-a4fa-4ada-be83-a05ac51c9102]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a, portal: 172.16.0.220,3260]
Apr 14 05:52:51 user nova-compute[71312]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a, portal: 172.16.0.220,3260] successful.
Apr 14 05:52:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d96db58-f364-48df-bc76-ea671a4b5d92]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] <== disconnect_volume: return (309ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:52:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'flavor' on Instance uuid 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.657s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:52 user nova-compute[71312]: INFO nova.compute.manager [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Terminating instance
Apr 14 05:52:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received event network-vif-unplugged-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] No waiting events found dispatching network-vif-unplugged-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received event network-vif-unplugged-eacc5441-0087-4493-832f-39661bf968e0 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:52:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Instance destroyed successfully.
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.objects.instance [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'resources' on Instance uuid 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2114465759',display_name='tempest-VolumesSnapshotTestJSON-instance-2114465759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2114465759',id=14,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e242403698514922aad5ec97ae17b1c8',ramdisk_id='',reservation_id='r-0woik53u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-186190223',owner_user_name='tempest-VolumesSnapshotTestJSON-186190223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:50:42Z,user_data=None,user_id='92aac6d019db4be3bfe3016653ccc7a0',uuid=91db166d-7af7-4aa7-90bd-a003048effa5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converting VIF {"id": "eacc5441-0087-4493-832f-39661bf968e0", "address": "fa:16:3e:bd:82:1a", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacc5441-00", "ovs_interfaceid": "eacc5441-0087-4493-832f-39661bf968e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:1a,bridge_name='br-int',has_traffic_filtering=True,id=eacc5441-0087-4493-832f-39661bf968e0,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacc5441-00') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_vif [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:1a,bridge_name='br-int',has_traffic_filtering=True,id=eacc5441-0087-4493-832f-39661bf968e0,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacc5441-00') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeacc5441-00, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:53 user nova-compute[71312]: INFO os_vif [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:1a,bridge_name='br-int',has_traffic_filtering=True,id=eacc5441-0087-4493-832f-39661bf968e0,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacc5441-00')
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYNzaulP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:52:53 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cf08e9-3b27-4ec7-aafa-547ddaeffb64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:52:53 user nova-compute[71312]: No targets found.
Apr 14 05:52:53 user nova-compute[71312]: iSNS:
Apr 14 05:52:53 user nova-compute[71312]: No targets found.
Apr 14 05:52:53 user nova-compute[71312]: STATIC:
Apr 14 05:52:53 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916
Apr 14 05:52:53 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:52:53 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:52:53 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7
Apr 14 05:52:53 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:52:53 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:52:53 user nova-compute[71312]: FIRMWARE:
Apr 14 05:52:53 user nova-compute[71312]: No targets found.
Apr 14 05:52:53 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:52:53 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:52:53 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79faff7e-a8ce-491e-843c-27e2a905be1a', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e437f6d0-7aa8-46bb-ba46-5f1a692e232d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8029ce0-6244-4cac-afe8-414fc8aadca9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:53 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:53 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:53 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:53 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49a453b010>, {}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Disconnecting from: [] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] <== disconnect_volume: return (70ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:52:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Deleting instance files /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5_del
Apr 14 05:52:53 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Deletion of /opt/stack/data/nova/instances/91db166d-7af7-4aa7-90bd-a003048effa5_del complete
Apr 14 05:52:53 user nova-compute[71312]: INFO nova.compute.manager [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:52:53 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Took 0.45 seconds to deallocate network for instance.
Apr 14 05:52:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-43ace8bc-ca0b-47b8-89d2-001b0370673e req-94c09fe0-ee28-48bc-adc7-9b3602d18247 service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received event network-vif-deleted-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:53 user nova-compute[71312]: WARNING nova.volume.cinder [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Attachment fa1d6f06-09ad-4325-994e-4d3c85d6b943 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fa1d6f06-09ad-4325-994e-4d3c85d6b943. (HTTP 404) (Request-ID: req-b9776ec7-0957-4c8d-b748-7611681c827d)
Apr 14 05:52:53 user nova-compute[71312]: INFO nova.compute.manager [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Took 0.02 seconds to detach 1 volumes for instance.
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:54 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Deleted allocations for instance 91db166d-7af7-4aa7-90bd-a003048effa5
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "91db166d-7af7-4aa7-90bd-a003048effa5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:52:54 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Creating image(s)
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Ensure instance console log exists: /opt/stack/data/nova/instances/4b2a98a9-3b3c-4e54-924e-47a5c69b1266/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Start _get_guest_xml network_info=[{"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T05:52:40Z,direct_url=<?>,disk_format='qcow2',id=d8eeaef1-eeb9-454d-bc23-87b68342c5c8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-407723315',owner='8134d4bfff8e465c8dc0a5342fee7e10',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T05:52:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'e4cfd119-13d2-4e5c-ad8e-5af329c14303', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeUZBtKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b2a98a9-3b3c-4e54-924e-47a5c69b1266', 'attached_at': '', 'detached_at': '', 'volume_id': '507353b0-790a-404c-9430-3f3f403c8596', 'serial': '507353b0-790a-404c-9430-3f3f403c8596'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:52:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:52:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T05:52:40Z,direct_url=<?>,disk_format='qcow2',id=d8eeaef1-eeb9-454d-bc23-87b68342c5c8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-407723315',owner='8134d4bfff8e465c8dc0a5342fee7e10',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T05:52:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeUZBtKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:52:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:52:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:52:54 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc29d572-a58d-4e88-909d-454e8074469a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:52:54 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a503a6b7-8b0c-4804-8316-92bd9d4ce100]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596] added
Apr 14 05:52:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe7ecc-4f3f-4cbd-ba7c-dbd344405008]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[706d43d6-95e6-4a36-9388-76b5ee1cc057]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeUZBtKn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeUZBtKn" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fa25e7-377a-4ed7-8f7e-5e0f17c31915]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MeUZBtKn'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b49f85-5511-4006-9615-29c63688483c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64e6acf-ea3c-4311-9b62-f03e03c43bb6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd41ec-9b4e-40aa-837a-ebbade5c1972]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596, portal: 172.16.0.220,3260]
Apr 14 05:52:54 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596, portal: 172.16.0.220,3260] successful.
Apr 14 05:52:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda0257f-ba56-4753-9c88-f61c8233c75e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf519614-c620-453c-aaa3-2fdde4c4f517]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:52:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[194d784e-f0ee-4ceb-a04e-60da13ec9a54]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received event network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] Acquiring lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] Lock "91db166d-7af7-4aa7-90bd-a003048effa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] No waiting events found dispatching network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:54 user nova-compute[71312]: WARNING nova.compute.manager [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Received unexpected event network-vif-plugged-eacc5441-0087-4493-832f-39661bf968e0 for instance with vm_state deleted and task_state None.
Apr 14 05:52:55 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeUZBtKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23830396265316337', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830396265316337', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-381474991',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-381474991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-381474991',id=18,image_ref='d8eeaef1-eeb9-454d-bc23-87b68342c5c8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-zic40ejb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2132265128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:52:44Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=4b2a98a9-3b3c-4e54-924e-47a5c69b1266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:a0:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c275402-2e94-4f9d-86ec-e0c921f8c0cf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c275402-2e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:52:55 user nova-compute[71312]:   <uuid>4b2a98a9-3b3c-4e54-924e-47a5c69b1266</uuid>
Apr 14 05:52:55 user nova-compute[71312]:   <name>instance-00000012</name>
Apr 14 05:52:55 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:52:55 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:52:55 user nova-compute[71312]:   <metadata>
Apr 14 05:52:55 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:52:55 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:52:55 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-381474991</nova:name>
Apr 14 05:52:55 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:52:54</nova:creationTime>
Apr 14 05:52:55 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:52:55 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:52:55 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:52:55 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:52:55 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:52:55 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:52:55 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:52:55 user nova-compute[71312]:       <nova:owner>
Apr 14 05:52:55 user nova-compute[71312]:         <nova:user uuid="670c42ab26ab49808773a20f14269e13">tempest-TestVolumeBootPattern-2132265128-project-member</nova:user>
Apr 14 05:52:55 user nova-compute[71312]:         <nova:project uuid="8134d4bfff8e465c8dc0a5342fee7e10">tempest-TestVolumeBootPattern-2132265128</nova:project>
Apr 14 05:52:55 user nova-compute[71312]:       </nova:owner>
Apr 14 05:52:55 user nova-compute[71312]:       <nova:root type="image" uuid="d8eeaef1-eeb9-454d-bc23-87b68342c5c8"/>
Apr 14 05:52:55 user nova-compute[71312]:       <nova:ports>
Apr 14 05:52:55 user nova-compute[71312]:         <nova:port uuid="6c275402-2e94-4f9d-86ec-e0c921f8c0cf">
Apr 14 05:52:55 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 05:52:55 user nova-compute[71312]:         </nova:port>
Apr 14 05:52:55 user nova-compute[71312]:       </nova:ports>
Apr 14 05:52:55 user nova-compute[71312]:     </nova:instance>
Apr 14 05:52:55 user nova-compute[71312]:   </metadata>
Apr 14 05:52:55 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:52:55 user nova-compute[71312]:     <system>
Apr 14 05:52:55 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:52:55 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:52:55 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:52:55 user nova-compute[71312]:       <entry name="serial">4b2a98a9-3b3c-4e54-924e-47a5c69b1266</entry>
Apr 14 05:52:55 user nova-compute[71312]:       <entry name="uuid">4b2a98a9-3b3c-4e54-924e-47a5c69b1266</entry>
Apr 14 05:52:55 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:52:55 user nova-compute[71312]:     </system>
Apr 14 05:52:55 user nova-compute[71312]:   </sysinfo>
Apr 14 05:52:55 user nova-compute[71312]:   <os>
Apr 14 05:52:55 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:52:55 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:52:55 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:52:55 user nova-compute[71312]:   </os>
Apr 14 05:52:55 user nova-compute[71312]:   <features>
Apr 14 05:52:55 user nova-compute[71312]:     <acpi/>
Apr 14 05:52:55 user nova-compute[71312]:     <apic/>
Apr 14 05:52:55 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:52:55 user nova-compute[71312]:   </features>
Apr 14 05:52:55 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:52:55 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:52:55 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:52:55 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:52:55 user nova-compute[71312]:   </clock>
Apr 14 05:52:55 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:52:55 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:52:55 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:52:55 user nova-compute[71312]:   </cpu>
Apr 14 05:52:55 user nova-compute[71312]:   <devices>
Apr 14 05:52:55 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:52:55 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:52:55 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 05:52:55 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:52:55 user nova-compute[71312]:       <serial>507353b0-790a-404c-9430-3f3f403c8596</serial>
Apr 14 05:52:55 user nova-compute[71312]:     </disk>
Apr 14 05:52:55 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:52:55 user nova-compute[71312]:       <mac address="fa:16:3e:31:a0:6a"/>
Apr 14 05:52:55 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:52:55 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:52:55 user nova-compute[71312]:       <target dev="tap6c275402-2e"/>
Apr 14 05:52:55 user nova-compute[71312]:     </interface>
Apr 14 05:52:55 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:52:55 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4b2a98a9-3b3c-4e54-924e-47a5c69b1266/console.log" append="off"/>
Apr 14 05:52:55 user nova-compute[71312]:     </serial>
Apr 14 05:52:55 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:52:55 user nova-compute[71312]:     <video>
Apr 14 05:52:55 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:52:55 user nova-compute[71312]:     </video>
Apr 14 05:52:55 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:52:55 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:52:55 user nova-compute[71312]:     </rng>
Apr 14 05:52:55 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:52:55 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:52:55 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:52:55 user nova-compute[71312]:     </memballoon>
Apr 14 05:52:55 user nova-compute[71312]:   </devices>
Apr 14 05:52:55 user nova-compute[71312]: </domain>
Apr 14 05:52:55 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-381474991',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-381474991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-381474991',id=18,image_ref='d8eeaef1-eeb9-454d-bc23-87b68342c5c8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-zic40ejb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2132265128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:52:44Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=4b2a98a9-3b3c-4e54-924e-47a5c69b1266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:a0:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c275402-2e94-4f9d-86ec-e0c921f8c0cf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c275402-2e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG os_vif [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:a0:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c275402-2e94-4f9d-86ec-e0c921f8c0cf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c275402-2e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c275402-2e, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c275402-2e, col_values=(('external_ids', {'iface-id': '6c275402-2e94-4f9d-86ec-e0c921f8c0cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:a0:6a', 'vm-uuid': '4b2a98a9-3b3c-4e54-924e-47a5c69b1266'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:55 user nova-compute[71312]: INFO os_vif [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:a0:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c275402-2e94-4f9d-86ec-e0c921f8c0cf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c275402-2e')
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:52:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No VIF found with MAC fa:16:3e:31:a0:6a, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received event network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] Acquiring lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] No waiting events found dispatching network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:57 user nova-compute[71312]: WARNING nova.compute.manager [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received unexpected event network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance with vm_state building and task_state spawning.
Apr 14 05:52:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451579.253391, 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:52:59 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] VM Resumed (Lifecycle Event)
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:52:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Instance spawned successfully.
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:52:59 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451579.2563827, 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:52:59 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] VM Started (Lifecycle Event)
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:52:59 user nova-compute[71312]: INFO nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Took 4.84 seconds to spawn the instance on the hypervisor.
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:52:59 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:52:59 user nova-compute[71312]: INFO nova.compute.manager [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Took 16.00 seconds to build instance.
Apr 14 05:52:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.091s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.554s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:59 user nova-compute[71312]: INFO nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Apr 14 05:52:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received event network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] Acquiring lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:52:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] No waiting events found dispatching network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:52:59 user nova-compute[71312]: WARNING nova.compute.manager [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received unexpected event network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance with vm_state active and task_state None.
Apr 14 05:53:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:04 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:53:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:07 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:07 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8274MB free_disk=26.35214614868164GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance bf721faf-a8f3-42d6-a980-a49232e383d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 88eea6fd-6dde-4692-891e-0587ae62d90c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:53:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:08 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451573.272399, 91db166d-7af7-4aa7-90bd-a003048effa5 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:08 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] VM Stopped (Lifecycle Event)
Apr 14 05:53:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-da655bde-732a-45d5-9beb-9016140f3f37 None None] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:53:10 user nova-compute[71312]: INFO nova.compute.claims [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Claim successful on node user
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:53:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.policy [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:53:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Creating image(s)
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "/opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "/opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk 1073741824" returned: 0 in 0.047s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating instance_info_cache with network_info: [{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Successfully created port: 37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Cannot resize image /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lazy-loading 'migration_context' on Instance uuid b0e24f0f-175f-4259-b38d-4fb58ecc508a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Ensure instance console log exists: /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Successfully updated port: 37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "refresh_cache-b0e24f0f-175f-4259-b38d-4fb58ecc508a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquired lock "refresh_cache-b0e24f0f-175f-4259-b38d-4fb58ecc508a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received event network-changed-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Refreshing instance network info cache due to event network-changed-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] Acquiring lock "refresh_cache-b0e24f0f-175f-4259-b38d-4fb58ecc508a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:53:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Updating instance_info_cache with network_info: [{"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Releasing lock "refresh_cache-b0e24f0f-175f-4259-b38d-4fb58ecc508a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Instance network_info: |[{"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] Acquired lock "refresh_cache-b0e24f0f-175f-4259-b38d-4fb58ecc508a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Refreshing network info cache for port 37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Start _get_guest_xml network_info=[{"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:53:13 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:13 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-575067684',display_name='tempest-ServersNegativeTestJSON-server-575067684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-575067684',id=19,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='289cfed4776048b18eca85457a194bfb',ramdisk_id='',reservation_id='r-qrlgns62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1687375833',owner_user_name='tempest-ServersNegativeTestJSON-1687375833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:11Z,user_data=None,user_id='4e56c03cd09f4a3882e8dffbbaa40c97',uuid=b0e24f0f-175f-4259-b38d-4fb58ecc508a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converting VIF {"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8d:94,bridge_name='br-int',has_traffic_filtering=True,id=37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e76a28-3f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lazy-loading 'pci_devices' on Instance uuid b0e24f0f-175f-4259-b38d-4fb58ecc508a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:53:13 user nova-compute[71312]:   <uuid>b0e24f0f-175f-4259-b38d-4fb58ecc508a</uuid>
Apr 14 05:53:13 user nova-compute[71312]:   <name>instance-00000013</name>
Apr 14 05:53:13 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:53:13 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:53:13 user nova-compute[71312]:   <metadata>
Apr 14 05:53:13 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:53:13 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:53:13 user nova-compute[71312]:       <nova:name>tempest-ServersNegativeTestJSON-server-575067684</nova:name>
Apr 14 05:53:13 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:53:13</nova:creationTime>
Apr 14 05:53:13 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:53:13 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:53:13 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:53:13 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:53:13 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:53:13 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:53:13 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:53:13 user nova-compute[71312]:       <nova:owner>
Apr 14 05:53:13 user nova-compute[71312]:         <nova:user uuid="4e56c03cd09f4a3882e8dffbbaa40c97">tempest-ServersNegativeTestJSON-1687375833-project-member</nova:user>
Apr 14 05:53:13 user nova-compute[71312]:         <nova:project uuid="289cfed4776048b18eca85457a194bfb">tempest-ServersNegativeTestJSON-1687375833</nova:project>
Apr 14 05:53:13 user nova-compute[71312]:       </nova:owner>
Apr 14 05:53:13 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:53:13 user nova-compute[71312]:       <nova:ports>
Apr 14 05:53:13 user nova-compute[71312]:         <nova:port uuid="37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8">
Apr 14 05:53:13 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 05:53:13 user nova-compute[71312]:         </nova:port>
Apr 14 05:53:13 user nova-compute[71312]:       </nova:ports>
Apr 14 05:53:13 user nova-compute[71312]:     </nova:instance>
Apr 14 05:53:13 user nova-compute[71312]:   </metadata>
Apr 14 05:53:13 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:53:13 user nova-compute[71312]:     <system>
Apr 14 05:53:13 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:53:13 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:53:13 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:53:13 user nova-compute[71312]:       <entry name="serial">b0e24f0f-175f-4259-b38d-4fb58ecc508a</entry>
Apr 14 05:53:13 user nova-compute[71312]:       <entry name="uuid">b0e24f0f-175f-4259-b38d-4fb58ecc508a</entry>
Apr 14 05:53:13 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:53:13 user nova-compute[71312]:     </system>
Apr 14 05:53:13 user nova-compute[71312]:   </sysinfo>
Apr 14 05:53:13 user nova-compute[71312]:   <os>
Apr 14 05:53:13 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:53:13 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:53:13 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:53:13 user nova-compute[71312]:   </os>
Apr 14 05:53:13 user nova-compute[71312]:   <features>
Apr 14 05:53:13 user nova-compute[71312]:     <acpi/>
Apr 14 05:53:13 user nova-compute[71312]:     <apic/>
Apr 14 05:53:13 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:53:13 user nova-compute[71312]:   </features>
Apr 14 05:53:13 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:53:13 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:53:13 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:53:13 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:53:13 user nova-compute[71312]:   </clock>
Apr 14 05:53:13 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:53:13 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:53:13 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:53:13 user nova-compute[71312]:   </cpu>
Apr 14 05:53:13 user nova-compute[71312]:   <devices>
Apr 14 05:53:13 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:53:13 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:53:13 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk"/>
Apr 14 05:53:13 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:53:13 user nova-compute[71312]:     </disk>
Apr 14 05:53:13 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:53:13 user nova-compute[71312]:       <mac address="fa:16:3e:46:8d:94"/>
Apr 14 05:53:13 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:13 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:53:13 user nova-compute[71312]:       <target dev="tap37e76a28-3f"/>
Apr 14 05:53:13 user nova-compute[71312]:     </interface>
Apr 14 05:53:13 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:53:13 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/console.log" append="off"/>
Apr 14 05:53:13 user nova-compute[71312]:     </serial>
Apr 14 05:53:13 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:53:13 user nova-compute[71312]:     <video>
Apr 14 05:53:13 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:13 user nova-compute[71312]:     </video>
Apr 14 05:53:13 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:53:13 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:53:13 user nova-compute[71312]:     </rng>
Apr 14 05:53:13 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:53:13 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:53:13 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:53:13 user nova-compute[71312]:     </memballoon>
Apr 14 05:53:13 user nova-compute[71312]:   </devices>
Apr 14 05:53:13 user nova-compute[71312]: </domain>
Apr 14 05:53:13 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-575067684',display_name='tempest-ServersNegativeTestJSON-server-575067684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-575067684',id=19,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='289cfed4776048b18eca85457a194bfb',ramdisk_id='',reservation_id='r-qrlgns62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1687375833',owner_user_name='tempest-ServersNegativeTestJSON-1687375833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:11Z,user_data=None,user_id='4e56c03cd09f4a3882e8dffbbaa40c97',uuid=b0e24f0f-175f-4259-b38d-4fb58ecc508a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converting VIF {"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8d:94,bridge_name='br-int',has_traffic_filtering=True,id=37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e76a28-3f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG os_vif [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8d:94,bridge_name='br-int',has_traffic_filtering=True,id=37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e76a28-3f') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37e76a28-3f, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37e76a28-3f, col_values=(('external_ids', {'iface-id': '37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:8d:94', 'vm-uuid': 'b0e24f0f-175f-4259-b38d-4fb58ecc508a'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:13 user nova-compute[71312]: INFO os_vif [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8d:94,bridge_name='br-int',has_traffic_filtering=True,id=37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e76a28-3f')
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] No VIF found with MAC fa:16:3e:46:8d:94, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Updated VIF entry in instance network info cache for port 37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Updating instance_info_cache with network_info: [{"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] Releasing lock "refresh_cache-b0e24f0f-175f-4259-b38d-4fb58ecc508a" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received event network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] Acquiring lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] No waiting events found dispatching network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:14 user nova-compute[71312]: WARNING nova.compute.manager [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received unexpected event network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance with vm_state building and task_state spawning.
Apr 14 05:53:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451596.7010753, b0e24f0f-175f-4259-b38d-4fb58ecc508a => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] VM Resumed (Lifecycle Event)
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:53:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Instance spawned successfully.
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451596.7054074, b0e24f0f-175f-4259-b38d-4fb58ecc508a => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] VM Started (Lifecycle Event)
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:53:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:53:16 user nova-compute[71312]: INFO nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received event network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] Acquiring lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] No waiting events found dispatching network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:16 user nova-compute[71312]: WARNING nova.compute.manager [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received unexpected event network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance with vm_state building and task_state spawning.
Apr 14 05:53:16 user nova-compute[71312]: INFO nova.compute.manager [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Took 6.55 seconds to build instance.
Apr 14 05:53:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.643s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:19 user nova-compute[71312]: INFO nova.compute.manager [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Terminating instance
Apr 14 05:53:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquired lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'info_cache' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-unplugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:53:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Instance destroyed successfully.
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'resources' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-586479502',display_name='tempest-ServerStableDeviceRescueTest-server-586479502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-586479502',id=2,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnWgZSvStsIdBllMYITUwmuqQ//xCF9VZ+dweCxYVF5I1+XtbvXBqpCGg+3VG6koL7nHVoTJQeDf4gOGrVLkZrfLOdLZg4fZIrvOc8FP4FDDoxD5XtGdp4wyTnOCB5exw==',key_name='tempest-keypair-1292881497',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:50:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93092d7530694b63aba0a085051c0520',ramdisk_id='',reservation_id='r-t4mr1l4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1786618110',owner_user_name='tempest-ServerStableDeviceRescueTest-1786618110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e733b69143e045bcbe99d823b02aab83',uuid=4a200376-4747-49ed-96d4-3fe9ac338dcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Converting VIF {"id": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "address": "fa:16:3e:e3:aa:09", "network": {"id": "94d980c4-edf3-4d22-8ae3-b029ad2d4516", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2096222062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93092d7530694b63aba0a085051c0520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5de51fa-66", "ovs_interfaceid": "b5de51fa-6654-4f76-89df-063a4d6ad4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:aa:09,bridge_name='br-int',has_traffic_filtering=True,id=b5de51fa-6654-4f76-89df-063a4d6ad4f0,network=Network(94d980c4-edf3-4d22-8ae3-b029ad2d4516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5de51fa-66') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG os_vif [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:aa:09,bridge_name='br-int',has_traffic_filtering=True,id=b5de51fa-6654-4f76-89df-063a4d6ad4f0,network=Network(94d980c4-edf3-4d22-8ae3-b029ad2d4516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5de51fa-66') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5de51fa-66, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:20 user nova-compute[71312]: INFO os_vif [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:aa:09,bridge_name='br-int',has_traffic_filtering=True,id=b5de51fa-6654-4f76-89df-063a4d6ad4f0,network=Network(94d980c4-edf3-4d22-8ae3-b029ad2d4516),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5de51fa-66')
Apr 14 05:53:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Deleting instance files /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc_del
Apr 14 05:53:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Deletion of /opt/stack/data/nova/instances/4a200376-4747-49ed-96d4-3fe9ac338dcc_del complete
Apr 14 05:53:20 user nova-compute[71312]: INFO nova.compute.manager [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 05:53:20 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating instance_info_cache with network_info: [{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Releasing lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance destroyed successfully.
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'resources' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_vif [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafbb14f2-3c, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:53:21 user nova-compute[71312]: INFO os_vif [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c')
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FReWMhZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:53:21 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[24820bd2-4e82-4d94-8ebb-a3d83f6efd4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:53:21 user nova-compute[71312]: No targets found.
Apr 14 05:53:21 user nova-compute[71312]: iSNS:
Apr 14 05:53:21 user nova-compute[71312]: No targets found.
Apr 14 05:53:21 user nova-compute[71312]: STATIC:
Apr 14 05:53:21 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916
Apr 14 05:53:21 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:53:21 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:53:21 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7
Apr 14 05:53:21 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:53:21 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:53:21 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596
Apr 14 05:53:21 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:53:21 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:53:21 user nova-compute[71312]: FIRMWARE:
Apr 14 05:53:21 user nova-compute[71312]: No targets found.
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:53:21 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:53:21 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c5ed18-ffc7-4c8f-b6ca-b8934c99db4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[73863cfc-ad73-4cdf-9b02-ece4faa6715f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c4132b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef91414-e092-4f9a-9687-5475b5ef6499]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a990da-09fa-41bb-a80c-f6b751d2926e]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d070100d-2e8a-455c-9a49-858d5a120e36]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76683f0-416e-4524-a3d7-314984f2d53c]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2413ea4f-d642-4247-97d1-82ebd751757a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fca893-e094-4cbc-9311-386179be479a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260]
Apr 14 05:53:21 user nova-compute[71312]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260] successful.
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62fbcbf-ba84-45d7-8ea6-92388ec55b69]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== disconnect_volume: return (368ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Start _get_guest_xml network_info=[{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '2f498b76-da3f-4b5e-9390-6c62ba63988b', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FReWMhZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8bc9e54a-dc25-421f-a380-a394b0867000', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5633694-9b3e-4f90-af91-b14d5be70916', 'serial': 'e5633694-9b3e-4f90-af91-b14d5be70916'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'numa_topology' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FReWMhZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:53:21 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:53:21 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:53:21 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfeb18f-e89f-4116-8a46-26b99b0caa87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:53:21 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70dd98-178a-4bc5-8b60-48b30003537b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916] added
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33eeaca-3cd8-4913-bcf1-6558d82a2964]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef248d81-3aaa-4ca1-8397-aaea74b1a044]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FReWMhZw {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Took 0.87 seconds to deallocate network for instance.
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FReWMhZw" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81713478-56b3-4907-ae3e-c118d3c6f1f9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FReWMhZw'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-deleted-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:21 user nova-compute[71312]: INFO nova.compute.manager [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Neutron deleted interface b5de51fa-6654-4f76-89df-063a4d6ad4f0; detaching it from the instance and deleting it from the info cache
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Detach interface failed, port_id=b5de51fa-6654-4f76-89df-063a4d6ad4f0, reason: Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b05887-d568-4fbc-a37e-db0291d1bf8c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e7f608-1a4d-4850-9c5f-5ead8269bc56]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df39e3d-d770-4058-97b0-f99dbc1649eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260]
Apr 14 05:53:21 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260] successful.
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9446ca3a-03f2-494e-9c54-ef3b148e662d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dd4dd1-1c2f-481c-af3c-d95928f5507a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:53:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c045f7-6a68-4e99-91e1-6d498212b36e]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FReWMhZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:53:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:22 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Deleted allocations for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc
Apr 14 05:53:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.336s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] Acquiring lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] Lock "4a200376-4747-49ed-96d4-3fe9ac338dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] No waiting events found dispatching network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:22 user nova-compute[71312]: WARNING nova.compute.manager [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Received unexpected event network-vif-plugged-b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance with vm_state deleted and task_state None.
Apr 14 05:53:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23432623235383265', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432623235383265', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:53:22 user nova-compute[71312]:   <uuid>8bc9e54a-dc25-421f-a380-a394b0867000</uuid>
Apr 14 05:53:22 user nova-compute[71312]:   <name>instance-0000000b</name>
Apr 14 05:53:22 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:53:22 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:53:22 user nova-compute[71312]:   <metadata>
Apr 14 05:53:22 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:53:22 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:53:22 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeTestJSON-server-680332699</nova:name>
Apr 14 05:53:22 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:53:21</nova:creationTime>
Apr 14 05:53:22 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:53:22 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:53:22 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:53:22 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:53:22 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:53:22 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:53:22 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:53:22 user nova-compute[71312]:       <nova:owner>
Apr 14 05:53:22 user nova-compute[71312]:         <nova:user uuid="3aa9911d299b409f9ccc8a55e7b3ec5b">tempest-AttachVolumeTestJSON-1872023683-project-member</nova:user>
Apr 14 05:53:22 user nova-compute[71312]:         <nova:project uuid="5c0f5758b623402393ec9eb273c7ae6f">tempest-AttachVolumeTestJSON-1872023683</nova:project>
Apr 14 05:53:22 user nova-compute[71312]:       </nova:owner>
Apr 14 05:53:22 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:53:22 user nova-compute[71312]:       <nova:ports>
Apr 14 05:53:22 user nova-compute[71312]:         <nova:port uuid="afbb14f2-3ce8-4993-b4cb-40e2c9567067">
Apr 14 05:53:22 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 05:53:22 user nova-compute[71312]:         </nova:port>
Apr 14 05:53:22 user nova-compute[71312]:       </nova:ports>
Apr 14 05:53:22 user nova-compute[71312]:     </nova:instance>
Apr 14 05:53:22 user nova-compute[71312]:   </metadata>
Apr 14 05:53:22 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:53:22 user nova-compute[71312]:     <system>
Apr 14 05:53:22 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:53:22 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:53:22 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:53:22 user nova-compute[71312]:       <entry name="serial">8bc9e54a-dc25-421f-a380-a394b0867000</entry>
Apr 14 05:53:22 user nova-compute[71312]:       <entry name="uuid">8bc9e54a-dc25-421f-a380-a394b0867000</entry>
Apr 14 05:53:22 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:53:22 user nova-compute[71312]:     </system>
Apr 14 05:53:22 user nova-compute[71312]:   </sysinfo>
Apr 14 05:53:22 user nova-compute[71312]:   <os>
Apr 14 05:53:22 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:53:22 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:53:22 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:53:22 user nova-compute[71312]:   </os>
Apr 14 05:53:22 user nova-compute[71312]:   <features>
Apr 14 05:53:22 user nova-compute[71312]:     <acpi/>
Apr 14 05:53:22 user nova-compute[71312]:     <apic/>
Apr 14 05:53:22 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:53:22 user nova-compute[71312]:   </features>
Apr 14 05:53:22 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:53:22 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:53:22 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:53:22 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:53:22 user nova-compute[71312]:   </clock>
Apr 14 05:53:22 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:53:22 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:53:22 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:53:22 user nova-compute[71312]:   </cpu>
Apr 14 05:53:22 user nova-compute[71312]:   <devices>
Apr 14 05:53:22 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:53:22 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:53:22 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk"/>
Apr 14 05:53:22 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:53:22 user nova-compute[71312]:     </disk>
Apr 14 05:53:22 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:53:22 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:53:22 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Apr 14 05:53:22 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 05:53:22 user nova-compute[71312]:       <serial>e5633694-9b3e-4f90-af91-b14d5be70916</serial>
Apr 14 05:53:22 user nova-compute[71312]:     </disk>
Apr 14 05:53:22 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:53:22 user nova-compute[71312]:       <mac address="fa:16:3e:4c:94:55"/>
Apr 14 05:53:22 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:22 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:53:22 user nova-compute[71312]:       <target dev="tapafbb14f2-3c"/>
Apr 14 05:53:22 user nova-compute[71312]:     </interface>
Apr 14 05:53:22 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:53:22 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/console.log" append="off"/>
Apr 14 05:53:22 user nova-compute[71312]:     </serial>
Apr 14 05:53:22 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:53:22 user nova-compute[71312]:     <video>
Apr 14 05:53:22 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:22 user nova-compute[71312]:     </video>
Apr 14 05:53:22 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:53:22 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:53:22 user nova-compute[71312]:     </rng>
Apr 14 05:53:22 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:53:22 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:53:22 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:53:22 user nova-compute[71312]:     </memballoon>
Apr 14 05:53:22 user nova-compute[71312]:   </devices>
Apr 14 05:53:22 user nova-compute[71312]: </domain>
Apr 14 05:53:22 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:53:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Cannot resize image /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'migration_context' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG os_vif [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafbb14f2-3c, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapafbb14f2-3c, col_values=(('external_ids', {'iface-id': 'afbb14f2-3ce8-4993-b4cb-40e2c9567067', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:94:55', 'vm-uuid': '8bc9e54a-dc25-421f-a380-a394b0867000'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:53:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:23 user nova-compute[71312]: INFO os_vif [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c')
Apr 14 05:53:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:25 user nova-compute[71312]: WARNING nova.compute.manager [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state stopped and task_state powering-on.
Apr 14 05:53:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451607.0191479, 8bc9e54a-dc25-421f-a380-a394b0867000 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:27 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Resumed (Lifecycle Event)
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:53:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance rebooted successfully.
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:27 user nova-compute[71312]: WARNING nova.compute.manager [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state stopped and task_state powering-on.
Apr 14 05:53:27 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451607.0229943, 8bc9e54a-dc25-421f-a380-a394b0867000 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:27 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Started (Lifecycle Event)
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:53:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:53:35 user nova-compute[71312]: INFO nova.compute.claims [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Claim successful on node user
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451600.5826645, 4a200376-4747-49ed-96d4-3fe9ac338dcc => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:35 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] VM Stopped (Lifecycle Event)
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6825b808-58b1-45ef-8d00-d5c05998913c None None] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:53:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:53:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:53:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:53:36 user nova-compute[71312]: INFO nova.virt.block_device [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Booting with blank volume at /dev/vda
Apr 14 05:53:36 user nova-compute[71312]: DEBUG nova.policy [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:53:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Successfully created port: 9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Successfully updated port: 9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquired lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-changed-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Refreshing instance network info cache due to event network-changed-9dfcb341-1a5c-4661-8f34-e559acf931b9. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] Acquiring lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:53:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating instance_info_cache with network_info: [{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Releasing lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance network_info: |[{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:53:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] Acquired lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Refreshing network info cache for port 9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:53:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updated VIF entry in instance network info cache for port 9dfcb341-1a5c-4661-8f34-e559acf931b9. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:53:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating instance_info_cache with network_info: [{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] Releasing lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:53:40 user nova-compute[71312]: INFO nova.compute.claims [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Claim successful on node user
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:53:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.policy [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:53:40 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Creating image(s)
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk 1073741824" returned: 0 in 0.051s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.128s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Cannot resize image /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'migration_context' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Ensure instance console log exists: /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Successfully created port: 98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG os_brick.utils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac2d46-8813-4d44-9c2c-40b99dccbd6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[13412831-d0fb-4ef7-94b6-e2c0c9f36e06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[221b4cda-c05e-468f-9c9c-92ea697a9c95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39ab70d-e206-4842-9db5-17972dc2ca74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:53:41 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:53:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa01e95f-b882-4eeb-98b5-8d5f40441ae8]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG os_brick.utils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:53:41 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating existing volume attachment record: a5f15057-ef6c-492c-b046-618dc269e84f {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Successfully updated port: 98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-changed-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.compute.manager [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Refreshing instance network info cache due to event network-changed-98a0c510-de09-47fb-b8cc-7a053b97eb82. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance network_info: |[{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Refreshing network info cache for port 98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Start _get_guest_xml network_info=[{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:53:42 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:42 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-493161134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:53:42 user nova-compute[71312]:   <uuid>4e8ac55a-5fe7-470b-b04e-97a9f00f3187</uuid>
Apr 14 05:53:42 user nova-compute[71312]:   <name>instance-00000015</name>
Apr 14 05:53:42 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:53:42 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:53:42 user nova-compute[71312]:   <metadata>
Apr 14 05:53:42 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:53:42 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:53:42 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestJSON-server-493161134</nova:name>
Apr 14 05:53:42 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:53:42</nova:creationTime>
Apr 14 05:53:42 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:53:42 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:53:42 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:53:42 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:53:42 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:53:42 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:53:42 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:53:42 user nova-compute[71312]:       <nova:owner>
Apr 14 05:53:42 user nova-compute[71312]:         <nova:user uuid="290b67b22a91443fbfc829fa4e3db036">tempest-ServerActionsTestJSON-31064769-project-member</nova:user>
Apr 14 05:53:42 user nova-compute[71312]:         <nova:project uuid="dbc4321a7868464faa59341018ed747f">tempest-ServerActionsTestJSON-31064769</nova:project>
Apr 14 05:53:42 user nova-compute[71312]:       </nova:owner>
Apr 14 05:53:42 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:53:42 user nova-compute[71312]:       <nova:ports>
Apr 14 05:53:42 user nova-compute[71312]:         <nova:port uuid="98a0c510-de09-47fb-b8cc-7a053b97eb82">
Apr 14 05:53:42 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 05:53:42 user nova-compute[71312]:         </nova:port>
Apr 14 05:53:42 user nova-compute[71312]:       </nova:ports>
Apr 14 05:53:42 user nova-compute[71312]:     </nova:instance>
Apr 14 05:53:42 user nova-compute[71312]:   </metadata>
Apr 14 05:53:42 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:53:42 user nova-compute[71312]:     <system>
Apr 14 05:53:42 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:53:42 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:53:42 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:53:42 user nova-compute[71312]:       <entry name="serial">4e8ac55a-5fe7-470b-b04e-97a9f00f3187</entry>
Apr 14 05:53:42 user nova-compute[71312]:       <entry name="uuid">4e8ac55a-5fe7-470b-b04e-97a9f00f3187</entry>
Apr 14 05:53:42 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:53:42 user nova-compute[71312]:     </system>
Apr 14 05:53:42 user nova-compute[71312]:   </sysinfo>
Apr 14 05:53:42 user nova-compute[71312]:   <os>
Apr 14 05:53:42 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:53:42 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:53:42 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:53:42 user nova-compute[71312]:   </os>
Apr 14 05:53:42 user nova-compute[71312]:   <features>
Apr 14 05:53:42 user nova-compute[71312]:     <acpi/>
Apr 14 05:53:42 user nova-compute[71312]:     <apic/>
Apr 14 05:53:42 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:53:42 user nova-compute[71312]:   </features>
Apr 14 05:53:42 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:53:42 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:53:42 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:53:42 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:53:42 user nova-compute[71312]:   </clock>
Apr 14 05:53:42 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:53:42 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:53:42 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:53:42 user nova-compute[71312]:   </cpu>
Apr 14 05:53:42 user nova-compute[71312]:   <devices>
Apr 14 05:53:42 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:53:42 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:53:42 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk"/>
Apr 14 05:53:42 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:53:42 user nova-compute[71312]:     </disk>
Apr 14 05:53:42 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:53:42 user nova-compute[71312]:       <mac address="fa:16:3e:6e:2e:0e"/>
Apr 14 05:53:42 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:42 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:53:42 user nova-compute[71312]:       <target dev="tap98a0c510-de"/>
Apr 14 05:53:42 user nova-compute[71312]:     </interface>
Apr 14 05:53:42 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:53:42 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/console.log" append="off"/>
Apr 14 05:53:42 user nova-compute[71312]:     </serial>
Apr 14 05:53:42 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:53:42 user nova-compute[71312]:     <video>
Apr 14 05:53:42 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:42 user nova-compute[71312]:     </video>
Apr 14 05:53:42 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:53:42 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:53:42 user nova-compute[71312]:     </rng>
Apr 14 05:53:42 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:53:42 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:53:42 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:53:42 user nova-compute[71312]:     </memballoon>
Apr 14 05:53:42 user nova-compute[71312]:   </devices>
Apr 14 05:53:42 user nova-compute[71312]: </domain>
Apr 14 05:53:42 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-493161134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG os_vif [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98a0c510-de, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98a0c510-de, col_values=(('external_ids', {'iface-id': '98a0c510-de09-47fb-b8cc-7a053b97eb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2e:0e', 'vm-uuid': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:42 user nova-compute[71312]: INFO os_vif [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de')
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No VIF found with MAC fa:16:3e:6e:2e:0e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updated VIF entry in instance network info cache for port 98a0c510-de09-47fb-b8cc-7a053b97eb82. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:44 user nova-compute[71312]: WARNING nova.compute.manager [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state building and task_state spawning.
Apr 14 05:53:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451626.0932045, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:46 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Resumed (Lifecycle Event)
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:53:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance spawned successfully.
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:46 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451626.0966427, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:46 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Started (Lifecycle Event)
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:53:46 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:53:46 user nova-compute[71312]: INFO nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:46 user nova-compute[71312]: WARNING nova.compute.manager [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state building and task_state spawning.
Apr 14 05:53:46 user nova-compute[71312]: INFO nova.compute.manager [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Took 6.19 seconds to build instance.
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.293s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:53:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Creating image(s)
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Ensure instance console log exists: /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Start _get_guest_xml network_info=[{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'a5f15057-ef6c-492c-b046-618dc269e84f', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzpPQqJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46ae7eba-11e8-4a56-b368-739848ed9dbc', 'attached_at': '', 'detached_at': '', 'volume_id': 'd68490bf-7fe3-4500-95a7-4f29aed845f9', 'serial': 'd68490bf-7fe3-4500-95a7-4f29aed845f9'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:53:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzpPQqJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:53:46 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:53:46 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:53:46 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[961dfe80-0182-4cf1-b3fd-3de33536ca20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:53:46 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a7f795-1d69-4fbb-ae34-ad0518a6baf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9] added
Apr 14 05:53:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f19cb1b-85f4-40a2-bfea-6a65dc812833]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ca85c-4816-4614-a31f-7f95ca91447e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzpPQqJZ {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzpPQqJZ" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5414430c-6c76-4bb7-a630-abd9d7a67b3b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzpPQqJZ'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b03e7-eec9-4cb2-8f9c-9dadd786e33b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[723795eb-52ad-4b08-a812-dea6c82cdc30]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2689d6c4-61a8-4efd-9e4b-021af3806d73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9, portal: 172.16.0.220,3260]
Apr 14 05:53:46 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9, portal: 172.16.0.220,3260] successful.
Apr 14 05:53:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da289158-d09b-4040-9c23-3a12aa50fa93]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ab096e-8577-49c4-a86f-7a6a8af7cdfd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:53:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:53:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90db478-44c9-4dfe-85f8-ec98788a3b15]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:53:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzpPQqJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:53:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23366313932633264', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366313932633264', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-793349449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-793349449',id=20,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-ox3x0y2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:36Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=46ae7eba-11e8-4a56-b368-739848ed9dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:32:c0,bridge_name='br-int',has_traffic_filtering=True,id=9dfcb341-1a5c-4661-8f34-e559acf931b9,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfcb341-1a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'pci_devices' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:53:48 user nova-compute[71312]:   <uuid>46ae7eba-11e8-4a56-b368-739848ed9dbc</uuid>
Apr 14 05:53:48 user nova-compute[71312]:   <name>instance-00000014</name>
Apr 14 05:53:48 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:53:48 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:53:48 user nova-compute[71312]:   <metadata>
Apr 14 05:53:48 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:53:48 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:53:48 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-793349449</nova:name>
Apr 14 05:53:48 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:53:46</nova:creationTime>
Apr 14 05:53:48 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:53:48 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:53:48 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:53:48 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:53:48 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:53:48 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:53:48 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:53:48 user nova-compute[71312]:       <nova:owner>
Apr 14 05:53:48 user nova-compute[71312]:         <nova:user uuid="c4946885e01a4f0da206d796027b3c9f">tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member</nova:user>
Apr 14 05:53:48 user nova-compute[71312]:         <nova:project uuid="7034e2177823496a861a1601a5c06fe4">tempest-ServerBootFromVolumeStableRescueTest-315541711</nova:project>
Apr 14 05:53:48 user nova-compute[71312]:       </nova:owner>
Apr 14 05:53:48 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:53:48 user nova-compute[71312]:       <nova:ports>
Apr 14 05:53:48 user nova-compute[71312]:         <nova:port uuid="9dfcb341-1a5c-4661-8f34-e559acf931b9">
Apr 14 05:53:48 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 05:53:48 user nova-compute[71312]:         </nova:port>
Apr 14 05:53:48 user nova-compute[71312]:       </nova:ports>
Apr 14 05:53:48 user nova-compute[71312]:     </nova:instance>
Apr 14 05:53:48 user nova-compute[71312]:   </metadata>
Apr 14 05:53:48 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:53:48 user nova-compute[71312]:     <system>
Apr 14 05:53:48 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:53:48 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:53:48 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:53:48 user nova-compute[71312]:       <entry name="serial">46ae7eba-11e8-4a56-b368-739848ed9dbc</entry>
Apr 14 05:53:48 user nova-compute[71312]:       <entry name="uuid">46ae7eba-11e8-4a56-b368-739848ed9dbc</entry>
Apr 14 05:53:48 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:53:48 user nova-compute[71312]:     </system>
Apr 14 05:53:48 user nova-compute[71312]:   </sysinfo>
Apr 14 05:53:48 user nova-compute[71312]:   <os>
Apr 14 05:53:48 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:53:48 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:53:48 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:53:48 user nova-compute[71312]:   </os>
Apr 14 05:53:48 user nova-compute[71312]:   <features>
Apr 14 05:53:48 user nova-compute[71312]:     <acpi/>
Apr 14 05:53:48 user nova-compute[71312]:     <apic/>
Apr 14 05:53:48 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:53:48 user nova-compute[71312]:   </features>
Apr 14 05:53:48 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:53:48 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:53:48 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:53:48 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:53:48 user nova-compute[71312]:   </clock>
Apr 14 05:53:48 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:53:48 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:53:48 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:53:48 user nova-compute[71312]:   </cpu>
Apr 14 05:53:48 user nova-compute[71312]:   <devices>
Apr 14 05:53:48 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:53:48 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:53:48 user nova-compute[71312]:       <source dev="/dev/sde"/>
Apr 14 05:53:48 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:53:48 user nova-compute[71312]:       <serial>d68490bf-7fe3-4500-95a7-4f29aed845f9</serial>
Apr 14 05:53:48 user nova-compute[71312]:     </disk>
Apr 14 05:53:48 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:53:48 user nova-compute[71312]:       <mac address="fa:16:3e:a0:32:c0"/>
Apr 14 05:53:48 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:48 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:53:48 user nova-compute[71312]:       <target dev="tap9dfcb341-1a"/>
Apr 14 05:53:48 user nova-compute[71312]:     </interface>
Apr 14 05:53:48 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:53:48 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/console.log" append="off"/>
Apr 14 05:53:48 user nova-compute[71312]:     </serial>
Apr 14 05:53:48 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:53:48 user nova-compute[71312]:     <video>
Apr 14 05:53:48 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:48 user nova-compute[71312]:     </video>
Apr 14 05:53:48 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:53:48 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:53:48 user nova-compute[71312]:     </rng>
Apr 14 05:53:48 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:53:48 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:53:48 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:53:48 user nova-compute[71312]:     </memballoon>
Apr 14 05:53:48 user nova-compute[71312]:   </devices>
Apr 14 05:53:48 user nova-compute[71312]: </domain>
Apr 14 05:53:48 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-793349449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-793349449',id=20,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-ox3x0y2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:36Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=46ae7eba-11e8-4a56-b368-739848ed9dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:32:c0,bridge_name='br-int',has_traffic_filtering=True,id=9dfcb341-1a5c-4661-8f34-e559acf931b9,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfcb341-1a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG os_vif [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:32:c0,bridge_name='br-int',has_traffic_filtering=True,id=9dfcb341-1a5c-4661-8f34-e559acf931b9,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfcb341-1a') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dfcb341-1a, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dfcb341-1a, col_values=(('external_ids', {'iface-id': '9dfcb341-1a5c-4661-8f34-e559acf931b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:32:c0', 'vm-uuid': '46ae7eba-11e8-4a56-b368-739848ed9dbc'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:48 user nova-compute[71312]: INFO os_vif [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:32:c0,bridge_name='br-int',has_traffic_filtering=True,id=9dfcb341-1a5c-4661-8f34-e559acf931b9,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfcb341-1a')
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:53:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No VIF found with MAC fa:16:3e:a0:32:c0, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:49 user nova-compute[71312]: WARNING nova.compute.manager [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state building and task_state spawning.
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451631.6254761, 46ae7eba-11e8-4a56-b368-739848ed9dbc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:51 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] VM Resumed (Lifecycle Event)
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:53:51 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance spawned successfully.
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:53:51 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451631.6281734, 46ae7eba-11e8-4a56-b368-739848ed9dbc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:53:51 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] VM Started (Lifecycle Event)
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:53:51 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:53:51 user nova-compute[71312]: INFO nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Took 5.10 seconds to spawn the instance on the hypervisor.
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:53:51 user nova-compute[71312]: WARNING nova.compute.manager [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state building and task_state spawning.
Apr 14 05:53:51 user nova-compute[71312]: INFO nova.compute.manager [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Took 16.38 seconds to build instance.
Apr 14 05:53:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.506s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:55 user nova-compute[71312]: INFO nova.compute.manager [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Unshelving
Apr 14 05:53:55 user nova-compute[71312]: INFO nova.virt.block_device [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Booting with volume c444d6ac-de53-4cae-b3d6-7365fbc7c282 at /dev/vdc
Apr 14 05:53:55 user nova-compute[71312]: DEBUG os_brick.utils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd87ff4-2db0-4a68-81a1-0bd0a3c98012]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae3ecd-aa1d-4bda-998a-641f5a75d565]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[de929050-2b06-4165-83a0-efcb963b69cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f05eb45-ac69-4187-a25b-885628f05787]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:53:55 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:53:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb60f2-b463-4834-bfa9-06e984c1399e]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG os_brick.utils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:53:55 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating existing volume attachment record: e9651854-7c34-4195-a0bd-1a5b17ad2618 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:53:56 user nova-compute[71312]: INFO nova.compute.claims [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Claim successful on node user
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:53:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.policy [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92aac6d019db4be3bfe3016653ccc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e242403698514922aad5ec97ae17b1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:53:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Creating image(s)
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "/opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "/opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk 1073741824" returned: 0 in 0.225s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.375s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Successfully created port: faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Cannot resize image /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'migration_context' on Instance uuid f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Ensure instance console log exists: /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:53:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Successfully updated port: faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "refresh_cache-f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquired lock "refresh_cache-f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received event network-changed-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Refreshing instance network info cache due to event network-changed-faffd2ae-2e8b-4a66-8121-dfc574aeb634. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] Acquiring lock "refresh_cache-f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Updating instance_info_cache with network_info: [{"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Releasing lock "refresh_cache-f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Instance network_info: |[{"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] Acquired lock "refresh_cache-f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.neutron [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Refreshing network info cache for port faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Start _get_guest_xml network_info=[{"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:53:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-105204178',display_name='tempest-VolumesSnapshotTestJSON-instance-105204178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-105204178',id=22,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e242403698514922aad5ec97ae17b1c8',ramdisk_id='',reservation_id='r-kh5jkumn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-186190223',owner_user_name='tempest-VolumesSnapshotTestJSON-186190223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:57Z,user_data=None,user_id='92aac6d019db4be3bfe3016653ccc7a0',uuid=f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converting VIF {"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:3f,bridge_name='br-int',has_traffic_filtering=True,id=faffd2ae-2e8b-4a66-8121-dfc574aeb634,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaffd2ae-2e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'pci_devices' on Instance uuid f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:53:58 user nova-compute[71312]:   <uuid>f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed</uuid>
Apr 14 05:53:58 user nova-compute[71312]:   <name>instance-00000016</name>
Apr 14 05:53:58 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:53:58 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:53:58 user nova-compute[71312]:   <metadata>
Apr 14 05:53:58 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:53:58 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:53:58 user nova-compute[71312]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-105204178</nova:name>
Apr 14 05:53:58 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:53:58</nova:creationTime>
Apr 14 05:53:58 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:53:58 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:53:58 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:53:58 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:53:58 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:53:58 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:53:58 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:53:58 user nova-compute[71312]:       <nova:owner>
Apr 14 05:53:58 user nova-compute[71312]:         <nova:user uuid="92aac6d019db4be3bfe3016653ccc7a0">tempest-VolumesSnapshotTestJSON-186190223-project-member</nova:user>
Apr 14 05:53:58 user nova-compute[71312]:         <nova:project uuid="e242403698514922aad5ec97ae17b1c8">tempest-VolumesSnapshotTestJSON-186190223</nova:project>
Apr 14 05:53:58 user nova-compute[71312]:       </nova:owner>
Apr 14 05:53:58 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:53:58 user nova-compute[71312]:       <nova:ports>
Apr 14 05:53:58 user nova-compute[71312]:         <nova:port uuid="faffd2ae-2e8b-4a66-8121-dfc574aeb634">
Apr 14 05:53:58 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 05:53:58 user nova-compute[71312]:         </nova:port>
Apr 14 05:53:58 user nova-compute[71312]:       </nova:ports>
Apr 14 05:53:58 user nova-compute[71312]:     </nova:instance>
Apr 14 05:53:58 user nova-compute[71312]:   </metadata>
Apr 14 05:53:58 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:53:58 user nova-compute[71312]:     <system>
Apr 14 05:53:58 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:53:58 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:53:58 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:53:58 user nova-compute[71312]:       <entry name="serial">f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed</entry>
Apr 14 05:53:58 user nova-compute[71312]:       <entry name="uuid">f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed</entry>
Apr 14 05:53:58 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:53:58 user nova-compute[71312]:     </system>
Apr 14 05:53:58 user nova-compute[71312]:   </sysinfo>
Apr 14 05:53:58 user nova-compute[71312]:   <os>
Apr 14 05:53:58 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:53:58 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:53:58 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:53:58 user nova-compute[71312]:   </os>
Apr 14 05:53:58 user nova-compute[71312]:   <features>
Apr 14 05:53:58 user nova-compute[71312]:     <acpi/>
Apr 14 05:53:58 user nova-compute[71312]:     <apic/>
Apr 14 05:53:58 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:53:58 user nova-compute[71312]:   </features>
Apr 14 05:53:58 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:53:58 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:53:58 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:53:58 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:53:58 user nova-compute[71312]:   </clock>
Apr 14 05:53:58 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:53:58 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:53:58 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:53:58 user nova-compute[71312]:   </cpu>
Apr 14 05:53:58 user nova-compute[71312]:   <devices>
Apr 14 05:53:58 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:53:58 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:53:58 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk"/>
Apr 14 05:53:58 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:53:58 user nova-compute[71312]:     </disk>
Apr 14 05:53:58 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:53:58 user nova-compute[71312]:       <mac address="fa:16:3e:62:f4:3f"/>
Apr 14 05:53:58 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:58 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:53:58 user nova-compute[71312]:       <target dev="tapfaffd2ae-2e"/>
Apr 14 05:53:58 user nova-compute[71312]:     </interface>
Apr 14 05:53:58 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:53:58 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/console.log" append="off"/>
Apr 14 05:53:58 user nova-compute[71312]:     </serial>
Apr 14 05:53:58 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:53:58 user nova-compute[71312]:     <video>
Apr 14 05:53:58 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:53:58 user nova-compute[71312]:     </video>
Apr 14 05:53:58 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:53:58 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:53:58 user nova-compute[71312]:     </rng>
Apr 14 05:53:58 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:53:58 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:53:58 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:53:58 user nova-compute[71312]:     </memballoon>
Apr 14 05:53:58 user nova-compute[71312]:   </devices>
Apr 14 05:53:58 user nova-compute[71312]: </domain>
Apr 14 05:53:58 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-105204178',display_name='tempest-VolumesSnapshotTestJSON-instance-105204178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-105204178',id=22,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e242403698514922aad5ec97ae17b1c8',ramdisk_id='',reservation_id='r-kh5jkumn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-186190223',owner_user_name='tempest-VolumesSnapshotTestJSON-186190223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:57Z,user_data=None,user_id='92aac6d019db4be3bfe3016653ccc7a0',uuid=f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converting VIF {"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:3f,bridge_name='br-int',has_traffic_filtering=True,id=faffd2ae-2e8b-4a66-8121-dfc574aeb634,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaffd2ae-2e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG os_vif [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:3f,bridge_name='br-int',has_traffic_filtering=True,id=faffd2ae-2e8b-4a66-8121-dfc574aeb634,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaffd2ae-2e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfaffd2ae-2e, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfaffd2ae-2e, col_values=(('external_ids', {'iface-id': 'faffd2ae-2e8b-4a66-8121-dfc574aeb634', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:f4:3f', 'vm-uuid': 'f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:53:58 user nova-compute[71312]: INFO os_vif [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:3f,bridge_name='br-int',has_traffic_filtering=True,id=faffd2ae-2e8b-4a66-8121-dfc574aeb634,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaffd2ae-2e')
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:53:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No VIF found with MAC fa:16:3e:62:f4:3f, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:53:59 user nova-compute[71312]: DEBUG nova.network.neutron [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Updated VIF entry in instance network info cache for port faffd2ae-2e8b-4a66-8121-dfc574aeb634. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:53:59 user nova-compute[71312]: DEBUG nova.network.neutron [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Updating instance_info_cache with network_info: [{"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:53:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] Releasing lock "refresh_cache-f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received event network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] No waiting events found dispatching network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:54:00 user nova-compute[71312]: WARNING nova.compute.manager [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received unexpected event network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance with vm_state building and task_state spawning.
Apr 14 05:54:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'pci_requests' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'numa_topology' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:54:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:54:00 user nova-compute[71312]: INFO nova.compute.claims [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Claim successful on node user
Apr 14 05:54:01 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:01 user nova-compute[71312]: INFO nova.network.neutron [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating port 2d2429bd-952a-41bd-8807-48328561c775 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquired lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-changed-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Refreshing instance network info cache due to event network-changed-2d2429bd-952a-41bd-8807-48328561c775. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:54:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] Acquiring lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451642.2448637, f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:54:02 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] VM Resumed (Lifecycle Event)
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:54:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Instance spawned successfully.
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:54:02 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451642.24616, f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:54:02 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] VM Started (Lifecycle Event)
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received event network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] No waiting events found dispatching network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:54:02 user nova-compute[71312]: WARNING nova.compute.manager [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received unexpected event network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance with vm_state building and task_state spawning.
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:54:02 user nova-compute[71312]: INFO nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Took 5.48 seconds to spawn the instance on the hypervisor.
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.network.neutron [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:54:02 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Releasing lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:54:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Creating image(s)
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] Acquired lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG nova.network.neutron [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Refreshing network info cache for port 2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "5829f1361080e38e95b111450c785f6ce7dc6f08" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "5829f1361080e38e95b111450c785f6ce7dc6f08" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:02 user nova-compute[71312]: INFO nova.compute.manager [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Took 6.31 seconds to build instance.
Apr 14 05:54:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.408s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08.part --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG nova.virt.images [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] e759324f-c97e-4c98-a662-32ce6a697745 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08.part /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08.part /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08.converted" returned: 0 in 0.339s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updated VIF entry in instance network info cache for port 2d2429bd-952a-41bd-8807-48328561c775. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] Releasing lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "5829f1361080e38e95b111450c785f6ce7dc6f08" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.358s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08 --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "5829f1361080e38e95b111450c785f6ce7dc6f08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "5829f1361080e38e95b111450c785f6ce7dc6f08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08,backing_fmt=raw /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08,backing_fmt=raw /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk 1073741824" returned: 0 in 0.047s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "5829f1361080e38e95b111450c785f6ce7dc6f08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08 --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'migration_context' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:54:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Rebasing disk image.
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.176s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 -F raw /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:04 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 -F raw /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk" returned: 0 in 1.862s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Ensure instance console log exists: /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Start _get_guest_xml network_info=[{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='fb857ed4b672dd25a33ba5028a541116',container_format='bare',created_at=2023-04-14T05:52:03Z,direct_url=<?>,disk_format='qcow2',id=e759324f-c97e-4c98-a662-32ce6a697745,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-553121458-shelved',owner='a335a6c17041473ca2abf256cb30a25f',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T05:52:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'e9651854-7c34-4195-a0bd-1a5b17ad2618', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeIwucvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '87153a66-bf2c-45f5-aa66-c94eaa6ea7ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'c444d6ac-de53-4cae-b3d6-7365fbc7c282', 'serial': 'c444d6ac-de53-4cae-b3d6-7365fbc7c282'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:54:06 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:54:06 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fb857ed4b672dd25a33ba5028a541116',container_format='bare',created_at=2023-04-14T05:52:03Z,direct_url=<?>,disk_format='qcow2',id=e759324f-c97e-4c98-a662-32ce6a697745,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-553121458-shelved',owner='a335a6c17041473ca2abf256cb30a25f',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T05:52:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeIwucvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:54:06 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:54:06 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:54:06 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b797002-678a-444e-99fd-556bb2033bb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:54:06 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7f1751-7f30-42bb-bf54-5144429c51cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282] added
Apr 14 05:54:06 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d158a27-aacd-48d5-9d3d-a367f65a3222]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38c5032-d056-44b0-8f43-2a4ebab577fd]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WeIwucvB {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WeIwucvB" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe7648f-cde1-4649-a314-dbd6b037e03d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WeIwucvB'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c28ec27-6c5a-4863-9171-cd60acdc4f5e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cc52b5-8221-492d-8095-6992d4739aac]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb960b9-a619-4062-8d0f-358d5cea8c86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282, portal: 172.16.0.220,3260]
Apr 14 05:54:06 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282, portal: 172.16.0.220,3260] successful.
Apr 14 05:54:06 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5f07b6-03f5-4ea9-9202-c1f3bade9e80]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0ab6bc-563a-4f1a-8bb7-f6f78b9cac1f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:54:06 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f448967-bf3e-40ad-b35f-dda2abaa9419]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeIwucvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26262366438623666', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262366438623666', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk --force-share --output=json" returned: 0 in 0.604s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-553121458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-553121458',id=13,image_ref='e759324f-c97e-4c98-a662-32ce6a697745',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1417329181',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:50:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-27lzq4z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member',shelved_at='2023-04-14T05:52:07.266191',shelved_host='user',shelved_image_id='e759324f-c97e-4c98-a662-32ce6a697745'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=87153a66-bf2c-45f5-aa66-c94eaa6ea7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'pci_devices' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:54:08 user nova-compute[71312]:   <uuid>87153a66-bf2c-45f5-aa66-c94eaa6ea7ea</uuid>
Apr 14 05:54:08 user nova-compute[71312]:   <name>instance-0000000d</name>
Apr 14 05:54:08 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:54:08 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:54:08 user nova-compute[71312]:   <metadata>
Apr 14 05:54:08 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:54:08 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:54:08 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-553121458</nova:name>
Apr 14 05:54:08 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:54:06</nova:creationTime>
Apr 14 05:54:08 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:54:08 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:54:08 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:54:08 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:54:08 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:54:08 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:54:08 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:54:08 user nova-compute[71312]:       <nova:owner>
Apr 14 05:54:08 user nova-compute[71312]:         <nova:user uuid="e7fece08f6f649bb89fc8ae5121bc2cc">tempest-AttachVolumeShelveTestJSON-1611001218-project-member</nova:user>
Apr 14 05:54:08 user nova-compute[71312]:         <nova:project uuid="a335a6c17041473ca2abf256cb30a25f">tempest-AttachVolumeShelveTestJSON-1611001218</nova:project>
Apr 14 05:54:08 user nova-compute[71312]:       </nova:owner>
Apr 14 05:54:08 user nova-compute[71312]:       <nova:root type="image" uuid="e759324f-c97e-4c98-a662-32ce6a697745"/>
Apr 14 05:54:08 user nova-compute[71312]:       <nova:ports>
Apr 14 05:54:08 user nova-compute[71312]:         <nova:port uuid="2d2429bd-952a-41bd-8807-48328561c775">
Apr 14 05:54:08 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 05:54:08 user nova-compute[71312]:         </nova:port>
Apr 14 05:54:08 user nova-compute[71312]:       </nova:ports>
Apr 14 05:54:08 user nova-compute[71312]:     </nova:instance>
Apr 14 05:54:08 user nova-compute[71312]:   </metadata>
Apr 14 05:54:08 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:54:08 user nova-compute[71312]:     <system>
Apr 14 05:54:08 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:54:08 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:54:08 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:54:08 user nova-compute[71312]:       <entry name="serial">87153a66-bf2c-45f5-aa66-c94eaa6ea7ea</entry>
Apr 14 05:54:08 user nova-compute[71312]:       <entry name="uuid">87153a66-bf2c-45f5-aa66-c94eaa6ea7ea</entry>
Apr 14 05:54:08 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:54:08 user nova-compute[71312]:     </system>
Apr 14 05:54:08 user nova-compute[71312]:   </sysinfo>
Apr 14 05:54:08 user nova-compute[71312]:   <os>
Apr 14 05:54:08 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:54:08 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:54:08 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:54:08 user nova-compute[71312]:   </os>
Apr 14 05:54:08 user nova-compute[71312]:   <features>
Apr 14 05:54:08 user nova-compute[71312]:     <acpi/>
Apr 14 05:54:08 user nova-compute[71312]:     <apic/>
Apr 14 05:54:08 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:54:08 user nova-compute[71312]:   </features>
Apr 14 05:54:08 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:54:08 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:54:08 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:54:08 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:54:08 user nova-compute[71312]:   </clock>
Apr 14 05:54:08 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:54:08 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:54:08 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:54:08 user nova-compute[71312]:   </cpu>
Apr 14 05:54:08 user nova-compute[71312]:   <devices>
Apr 14 05:54:08 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:54:08 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:54:08 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk"/>
Apr 14 05:54:08 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:54:08 user nova-compute[71312]:     </disk>
Apr 14 05:54:08 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:54:08 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:54:08 user nova-compute[71312]:       <source dev="/dev/sdf"/>
Apr 14 05:54:08 user nova-compute[71312]:       <target dev="vdc" bus="virtio"/>
Apr 14 05:54:08 user nova-compute[71312]:       <serial>c444d6ac-de53-4cae-b3d6-7365fbc7c282</serial>
Apr 14 05:54:08 user nova-compute[71312]:     </disk>
Apr 14 05:54:08 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:54:08 user nova-compute[71312]:       <mac address="fa:16:3e:6c:a9:eb"/>
Apr 14 05:54:08 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:54:08 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:54:08 user nova-compute[71312]:       <target dev="tap2d2429bd-95"/>
Apr 14 05:54:08 user nova-compute[71312]:     </interface>
Apr 14 05:54:08 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:54:08 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/console.log" append="off"/>
Apr 14 05:54:08 user nova-compute[71312]:     </serial>
Apr 14 05:54:08 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:54:08 user nova-compute[71312]:     <video>
Apr 14 05:54:08 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:54:08 user nova-compute[71312]:     </video>
Apr 14 05:54:08 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:54:08 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:54:08 user nova-compute[71312]:     </rng>
Apr 14 05:54:08 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:54:08 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:54:08 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:54:08 user nova-compute[71312]:     </memballoon>
Apr 14 05:54:08 user nova-compute[71312]:   </devices>
Apr 14 05:54:08 user nova-compute[71312]: </domain>
Apr 14 05:54:08 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-553121458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-553121458',id=13,image_ref='e759324f-c97e-4c98-a662-32ce6a697745',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1417329181',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:50:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-27lzq4z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member',shelved_at='2023-04-14T05:52:07.266191',shelved_host='user',shelved_image_id='e759324f-c97e-4c98-a662-32ce6a697745'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=87153a66-bf2c-45f5-aa66-c94eaa6ea7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG os_vif [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d2429bd-95, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d2429bd-95, col_values=(('external_ids', {'iface-id': '2d2429bd-952a-41bd-8807-48328561c775', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:a9:eb', 'vm-uuid': '87153a66-bf2c-45f5-aa66-c94eaa6ea7ea'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:08 user nova-compute[71312]: INFO os_vif [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95')
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No VIF found with MAC fa:16:3e:6c:a9:eb, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451652.1237803, 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:54:12 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] VM Resumed (Lifecycle Event)
Apr 14 05:54:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] No waiting events found dispatching network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:54:12 user nova-compute[71312]: WARNING nova.compute.manager [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received unexpected event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] No waiting events found dispatching network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:54:12 user nova-compute[71312]: WARNING nova.compute.manager [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received unexpected event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:54:12 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:54:12 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=26.300434112548828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:12 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451652.123952, 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:54:12 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] VM Started (Lifecycle Event)
Apr 14 05:54:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance spawned successfully.
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:54:12 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance bf721faf-a8f3-42d6-a980-a49232e383d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 88eea6fd-6dde-4692-891e-0587ae62d90c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (e19fba5b-1054-4428-a84f-a1d3a8496382): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:54:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.239s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:54:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:54:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:54:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [{"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:54:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:54:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:33 user nova-compute[71312]: INFO nova.compute.manager [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Terminating instance
Apr 14 05:54:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:54:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received event network-vif-unplugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] Acquiring lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] No waiting events found dispatching network-vif-unplugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received event network-vif-unplugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Instance destroyed successfully.
Apr 14 05:54:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'resources' on Instance uuid 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-381474991',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-381474991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-381474991',id=18,image_ref='d8eeaef1-eeb9-454d-bc23-87b68342c5c8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:52:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-zic40ejb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2132265128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:52:59Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=4b2a98a9-3b3c-4e54-924e-47a5c69b1266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "address": "fa:16:3e:31:a0:6a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c275402-2e", "ovs_interfaceid": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:a0:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c275402-2e94-4f9d-86ec-e0c921f8c0cf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c275402-2e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_vif [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:a0:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c275402-2e94-4f9d-86ec-e0c921f8c0cf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c275402-2e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c275402-2e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:54:34 user nova-compute[71312]: INFO os_vif [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:a0:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c275402-2e94-4f9d-86ec-e0c921f8c0cf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c275402-2e')
Apr 14 05:54:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeUZBtKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:54:34 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39165f-7216-4da8-8cbe-2a79a35878c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:54:34 user nova-compute[71312]: No targets found.
Apr 14 05:54:34 user nova-compute[71312]: iSNS:
Apr 14 05:54:34 user nova-compute[71312]: No targets found.
Apr 14 05:54:34 user nova-compute[71312]: STATIC:
Apr 14 05:54:34 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916
Apr 14 05:54:34 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:54:34 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:54:34 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282
Apr 14 05:54:34 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:54:34 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:54:34 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7
Apr 14 05:54:34 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:54:34 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:54:34 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596
Apr 14 05:54:34 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:54:34 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:54:34 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:54:34 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:54:34 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:54:34 user nova-compute[71312]: FIRMWARE:
Apr 14 05:54:34 user nova-compute[71312]: No targets found.
Apr 14 05:54:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:54:34 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:54:34 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8586edb2-c41e-4528-adec-60be296da0f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[01577d47-c106-4896-8c80-867c488922ad]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:54:34 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e42e0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de6c782-94da-4282-900e-42a3203e1067]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea6bf29-9649-433c-8da1-3d738ebe4349]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[22515a2e-71e5-4f07-a492-9ef1f04b53f0]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6faf3a-f09e-4314-843e-814a911b5fbf]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO93323518-809be1c79f3abe46', '/dev/disk/by-id/scsi-23830396265316337', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_93323518') {{(pid=81359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 05:54:34 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO93323518-809be1c79f3abe46
Apr 14 05:54:34 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23830396265316337
Apr 14 05:54:34 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_93323518
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4289e62-530e-431d-9436-e31d3cb120c6]: (4, None) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:54:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e46965-6ee5-4de2-aeb0-dd605ec30320]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab49b80-648b-420f-8c14-9999dcd003f1]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596, portal: 172.16.0.220,3260]
Apr 14 05:54:35 user nova-compute[71312]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596, portal: 172.16.0.220,3260] successful.
Apr 14 05:54:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:507353b0-790a-404c-9430-3f3f403c8596 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94d0ee3-8896-4baa-a830-19c97d83b385]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== disconnect_volume: return (394ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:54:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Deleting instance files /opt/stack/data/nova/instances/4b2a98a9-3b3c-4e54-924e-47a5c69b1266_del
Apr 14 05:54:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Deletion of /opt/stack/data/nova/instances/4b2a98a9-3b3c-4e54-924e-47a5c69b1266_del complete
Apr 14 05:54:35 user nova-compute[71312]: INFO nova.compute.manager [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Took 1.49 seconds to destroy the instance on the hypervisor.
Apr 14 05:54:35 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:54:35 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Took 0.50 seconds to deallocate network for instance.
Apr 14 05:54:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received event network-vif-deleted-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:54:35 user nova-compute[71312]: INFO nova.compute.manager [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Neutron deleted interface 6c275402-2e94-4f9d-86ec-e0c921f8c0cf; detaching it from the instance and deleting it from the info cache
Apr 14 05:54:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:54:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Detach interface failed, port_id=6c275402-2e94-4f9d-86ec-e0c921f8c0cf, reason: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:54:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received event network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:54:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] Acquiring lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] No waiting events found dispatching network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:54:36 user nova-compute[71312]: WARNING nova.compute.manager [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Received unexpected event network-vif-plugged-6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance with vm_state active and task_state deleting.
Apr 14 05:54:36 user nova-compute[71312]: INFO nova.compute.manager [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Took 0.93 seconds to detach 1 volumes for instance.
Apr 14 05:54:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Deleting volume: 507353b0-790a-404c-9430-3f3f403c8596 {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 05:54:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:54:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:54:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:54:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:54:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:37 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Deleted allocations for instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266
Apr 14 05:54:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "4b2a98a9-3b3c-4e54-924e-47a5c69b1266" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.527s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:54:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:49 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451674.6611726, 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:54:49 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] VM Stopped (Lifecycle Event)
Apr 14 05:54:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7fb1a987-c4d0-4535-96e3-29e7fd726e0b None None] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:54:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:54:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:00 user nova-compute[71312]: INFO nova.compute.manager [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Terminating instance
Apr 14 05:55:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received event network-vif-unplugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] Acquiring lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] No waiting events found dispatching network-vif-unplugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received event network-vif-unplugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Instance destroyed successfully.
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lazy-loading 'resources' on Instance uuid b0e24f0f-175f-4259-b38d-4fb58ecc508a {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-575067684',display_name='tempest-ServersNegativeTestJSON-server-575067684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-575067684',id=19,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='289cfed4776048b18eca85457a194bfb',ramdisk_id='',reservation_id='r-qrlgns62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1687375833',owner_user_name='tempest-ServersNegativeTestJSON-1687375833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:53:17Z,user_data=None,user_id='4e56c03cd09f4a3882e8dffbbaa40c97',uuid=b0e24f0f-175f-4259-b38d-4fb58ecc508a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converting VIF {"id": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "address": "fa:16:3e:46:8d:94", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e76a28-3f", "ovs_interfaceid": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:8d:94,bridge_name='br-int',has_traffic_filtering=True,id=37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e76a28-3f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG os_vif [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8d:94,bridge_name='br-int',has_traffic_filtering=True,id=37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e76a28-3f') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37e76a28-3f, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:55:01 user nova-compute[71312]: INFO os_vif [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:8d:94,bridge_name='br-int',has_traffic_filtering=True,id=37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e76a28-3f')
Apr 14 05:55:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Deleting instance files /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a_del
Apr 14 05:55:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Deletion of /opt/stack/data/nova/instances/b0e24f0f-175f-4259-b38d-4fb58ecc508a_del complete
Apr 14 05:55:01 user nova-compute[71312]: INFO nova.compute.manager [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 14 05:55:01 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:55:01 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Took 0.45 seconds to deallocate network for instance.
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received event network-vif-deleted-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:01 user nova-compute[71312]: INFO nova.compute.manager [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Neutron deleted interface 37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8; detaching it from the instance and deleting it from the info cache
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Detach interface failed, port_id=37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8, reason: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:55:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:01 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Deleted allocations for instance b0e24f0f-175f-4259-b38d-4fb58ecc508a
Apr 14 05:55:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.618s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received event network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] Acquiring lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] Lock "b0e24f0f-175f-4259-b38d-4fb58ecc508a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] No waiting events found dispatching network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:02 user nova-compute[71312]: WARNING nova.compute.manager [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Received unexpected event network-vif-plugged-37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance with vm_state deleted and task_state None.
Apr 14 05:55:04 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:55:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:55:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=26.36227798461914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance bf721faf-a8f3-42d6-a980-a49232e383d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 88eea6fd-6dde-4692-891e-0587ae62d90c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:55:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:11 user nova-compute[71312]: INFO nova.compute.manager [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Detaching volume e5633694-9b3e-4f90-af91-b14d5be70916
Apr 14 05:55:11 user nova-compute[71312]: INFO nova.virt.block_device [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Attempting to driver detach volume e5633694-9b3e-4f90-af91-b14d5be70916 from mountpoint /dev/vdb
Apr 14 05:55:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Attempting to detach device vdb from instance 8bc9e54a-dc25-421f-a380-a394b0867000 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:55:11 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:55:11 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 05:55:11 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:55:11 user nova-compute[71312]:   <serial>e5633694-9b3e-4f90-af91-b14d5be70916</serial>
Apr 14 05:55:11 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 05:55:11 user nova-compute[71312]: </disk>
Apr 14 05:55:11 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:55:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully detached device vdb from instance 8bc9e54a-dc25-421f-a380-a394b0867000 from the persistent domain config.
Apr 14 05:55:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bc9e54a-dc25-421f-a380-a394b0867000 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:55:11 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:55:11 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 05:55:11 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:55:11 user nova-compute[71312]:   <serial>e5633694-9b3e-4f90-af91-b14d5be70916</serial>
Apr 14 05:55:11 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 05:55:11 user nova-compute[71312]: </disk>
Apr 14 05:55:11 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451711.641604, 8bc9e54a-dc25-421f-a380-a394b0867000 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:55:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully detached device vdb from instance 8bc9e54a-dc25-421f-a380-a394b0867000 from the live domain config.
Apr 14 05:55:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FReWMhZw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:55:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5090e516-19ef-4471-b27a-af44e89a9f12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:55:11 user nova-compute[71312]: No targets found.
Apr 14 05:55:11 user nova-compute[71312]: iSNS:
Apr 14 05:55:11 user nova-compute[71312]: No targets found.
Apr 14 05:55:11 user nova-compute[71312]: STATIC:
Apr 14 05:55:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916
Apr 14 05:55:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:11 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282
Apr 14 05:55:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:11 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7
Apr 14 05:55:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:11 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:55:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:11 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:11 user nova-compute[71312]: FIRMWARE:
Apr 14 05:55:11 user nova-compute[71312]: No targets found.
Apr 14 05:55:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:55:11 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:55:11 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb496368-6e1e-46d4-9f5b-bca31e83acef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e4c11-d8ac-4ce8-8160-13d9b3368c94]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:55:11 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:55:11 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:11 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:55:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:55:11 user nova-compute[71312]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 (non-flash)
Apr 14 05:55:11 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:11 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:55:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea3f63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[57571294-54ac-40fd-8871-019eba34935d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d3c7b0-9e2a-42a2-8876-1d68dab54f7d]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafcbde7-1b59-42fa-ac8d-c6e7d8d1828e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4047cd6-1b6b-4d1d-8b49-730e61e3aa5d]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cf01a1-df8a-4504-bb9e-f7aa8c7f2af7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b5136-a5d5-4a64-8a44-3c58d34e7ce1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260]
Apr 14 05:55:11 user nova-compute[71312]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916, portal: 172.16.0.220,3260] successful.
Apr 14 05:55:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5633694-9b3e-4f90-af91-b14d5be70916 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bbc947-c79f-4593-b0ef-483d1bcfd391]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== disconnect_volume: return (327ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:55:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:55:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.746s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71312) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:13 user nova-compute[71312]: WARNING nova.compute.manager [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state active and task_state powering-off.
Apr 14 05:55:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance destroyed successfully.
Apr 14 05:55:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.851s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updating instance_info_cache with network_info: [{"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:55:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:55:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:15 user nova-compute[71312]: WARNING nova.compute.manager [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state stopped and task_state None.
Apr 14 05:55:16 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451701.0136015, b0e24f0f-175f-4259-b38d-4fb58ecc508a => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:55:16 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] VM Stopped (Lifecycle Event)
Apr 14 05:55:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-77bb36b7-3fc0-480e-847e-c69aed14f7c5 None None] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:55:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:26 user nova-compute[71312]: INFO nova.compute.manager [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Rescuing
Apr 14 05:55:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquired lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating instance_info_cache with network_info: [{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Releasing lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:26 user nova-compute[71312]: WARNING nova.compute.manager [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state active and task_state rescuing.
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:27 user nova-compute[71312]: INFO nova.compute.manager [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Terminating instance
Apr 14 05:55:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance destroyed successfully.
Apr 14 05:55:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Attempting a stable device rescue
Apr 14 05:55:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 05:55:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Creating image(s)
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "/opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "/opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "/opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'trusted_certs' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "c585a2f4240818c74a4db09500eef328cfe4048b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "c585a2f4240818c74a4db09500eef328cfe4048b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Instance destroyed successfully.
Apr 14 05:55:28 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'resources' on Instance uuid bf721faf-a8f3-42d6-a980-a49232e383d4 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1002232884',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1002232884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1002232884',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-ut200gpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:51:00Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=bf721faf-a8f3-42d6-a980-a49232e383d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "address": "fa:16:3e:5d:0f:5d", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd1b88-04", "ovs_interfaceid": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd1b88-04') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_vif [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd1b88-04') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4bd1b88-04, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:28 user nova-compute[71312]: INFO os_vif [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0f:5d,bridge_name='br-int',has_traffic_filtering=True,id=f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd1b88-04')
Apr 14 05:55:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbageAzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:55:28 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b.part --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG nova.virt.images [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] cf95c14b-affd-4386-adf2-cbd9535b19b4 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b.part /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[89460ea4-6b63-4da4-b357-3f595b133949]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:55:28 user nova-compute[71312]: No targets found.
Apr 14 05:55:28 user nova-compute[71312]: iSNS:
Apr 14 05:55:28 user nova-compute[71312]: No targets found.
Apr 14 05:55:28 user nova-compute[71312]: STATIC:
Apr 14 05:55:28 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282
Apr 14 05:55:28 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:28 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:28 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7
Apr 14 05:55:28 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:28 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:28 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:55:28 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:28 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:28 user nova-compute[71312]: FIRMWARE:
Apr 14 05:55:28 user nova-compute[71312]: No targets found.
Apr 14 05:55:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:55:28 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:55:28 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e8f2e-8b01-45ad-8085-f5c63c9cb34d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc73abd-f036-44c6-83c2-dc1302c16012]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:55:28 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:28 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:55:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 (non-flash)
Apr 14 05:55:28 user nova-compute[71312]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:28 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:55:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea220790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7fab5b-e503-4343-b2d2-1cad92c6c831]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0bc02b-da41-4627-ad6e-a13b2932b5fd]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7a0813-656f-4008-ab6f-0e07b7400d6a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:55:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b.part /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b.converted" returned: 0 in 0.282s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.084s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b222925-887f-46b1-88e0-876bb5af7c99]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:29 user nova-compute[71312]: WARNING nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state active and task_state rescuing.
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-unplugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] No waiting events found dispatching network-vif-unplugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-unplugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] No waiting events found dispatching network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:29 user nova-compute[71312]: WARNING nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received unexpected event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance with vm_state active and task_state deleting.
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] No waiting events found dispatching network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:29 user nova-compute[71312]: WARNING nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received unexpected event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance with vm_state active and task_state deleting.
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] No waiting events found dispatching network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:29 user nova-compute[71312]: WARNING nova.compute.manager [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received unexpected event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance with vm_state active and task_state deleting.
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451714.1002388, 8bc9e54a-dc25-421f-a380-a394b0867000 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:55:29 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Stopped (Lifecycle Event)
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7ad10ff0-da44-453a-a786-9fa96a341c51 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52b0030-66b6-4d28-b81a-4e96123e77c8]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7ad10ff0-da44-453a-a786-9fa96a341c51 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "c585a2f4240818c74a4db09500eef328cfe4048b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.606s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "c585a2f4240818c74a4db09500eef328cfe4048b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "c585a2f4240818c74a4db09500eef328cfe4048b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f31faf-750b-499c-8d19-7f1ae7aa0f57]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7, portal: 172.16.0.220,3260]
Apr 14 05:55:29 user nova-compute[71312]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7, portal: 172.16.0.220,3260] successful.
Apr 14 05:55:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbbc188-4e33-44fe-9723-30a4d276f9e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73cbe7-b7ee-4048-aac9-c278d97dab47]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.552s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== disconnect_volume: return (554ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:55:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Deleting instance files /opt/stack/data/nova/instances/bf721faf-a8f3-42d6-a980-a49232e383d4_del
Apr 14 05:55:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Deletion of /opt/stack/data/nova/instances/bf721faf-a8f3-42d6-a980-a49232e383d4_del complete
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b,backing_fmt=raw /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:29 user nova-compute[71312]: INFO nova.compute.manager [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Took 1.99 seconds to destroy the instance on the hypervisor.
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b,backing_fmt=raw /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue" returned: 0 in 0.057s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "c585a2f4240818c74a4db09500eef328cfe4048b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'migration_context' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Start _get_guest_xml network_info=[{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "vif_mac": "fa:16:3e:a0:32:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf95c14b-affd-4386-adf2-cbd9535b19b4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'a5f15057-ef6c-492c-b046-618dc269e84f', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzpPQqJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '46ae7eba-11e8-4a56-b368-739848ed9dbc', 'attached_at': '', 'detached_at': '', 'volume_id': 'd68490bf-7fe3-4500-95a7-4f29aed845f9', 'serial': 'd68490bf-7fe3-4500-95a7-4f29aed845f9'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'resources' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'numa_topology' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:55:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzpPQqJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:55:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:55:29 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:55:29 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a094a08-0129-4a52-8874-fab685cd9182]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TzpPQqJZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 05:55:29 user nova-compute[71312]: node.name = iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:55:29 user nova-compute[71312]: node.tpgt = -1
Apr 14 05:55:29 user nova-compute[71312]: node.startup = automatic
Apr 14 05:55:29 user nova-compute[71312]: node.leading_login = No
Apr 14 05:55:29 user nova-compute[71312]: iface.iscsi_ifacename = default
Apr 14 05:55:29 user nova-compute[71312]: iface.net_ifacename = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.ipaddress = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.prefix_len = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.hwaddress = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.transport_name = tcp
Apr 14 05:55:29 user nova-compute[71312]: iface.initiatorname = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.state = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.vlan_id = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.vlan_priority = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.vlan_state = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.iface_num = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.mtu = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.port = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.bootproto = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.subnet_mask = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.gateway = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.dhcp_alt_client_id = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.dhcp_dns = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.dhcp_learn_iqn = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.dhcp_vendor_id_state = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.dhcp_vendor_id = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.dhcp_slp_da = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.fragmentation = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.gratuitous_arp = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.incoming_forwarding = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.tos_state = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.tos = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.ttl = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.delayed_ack = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.tcp_nagle = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.tcp_wsf_state = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.tcp_wsf = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.tcp_timer_scale = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.tcp_timestamp = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.redirect = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.def_task_mgmt_timeout = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.header_digest = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.data_digest = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.immediate_data = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.initial_r2t = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.data_seq_inorder = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.data_pdu_inorder = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.erl = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.max_receive_data_len = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.first_burst_len = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.max_outstanding_r2t = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.max_burst_len = 0
Apr 14 05:55:29 user nova-compute[71312]: iface.chap_auth = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.bidi_chap = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.strict_login_compliance = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.discovery_auth = <empty>
Apr 14 05:55:29 user nova-compute[71312]: iface.discovery_logout = <empty>
Apr 14 05:55:29 user nova-compute[71312]: node.discovery_address = <empty>
Apr 14 05:55:29 user nova-compute[71312]: node.discovery_port = 0
Apr 14 05:55:29 user nova-compute[71312]: node.discovery_type = static
Apr 14 05:55:29 user nova-compute[71312]: node.session.initial_cmdsn = 0
Apr 14 05:55:29 user nova-compute[71312]: node.session.initial_login_retry_max = 8
Apr 14 05:55:29 user nova-compute[71312]: node.session.xmit_thread_priority = -20
Apr 14 05:55:29 user nova-compute[71312]: node.session.cmds_max = 128
Apr 14 05:55:29 user nova-compute[71312]: node.session.queue_depth = 32
Apr 14 05:55:29 user nova-compute[71312]: node.session.nr_sessions = 1
Apr 14 05:55:29 user nova-compute[71312]: node.session.auth.authmethod = CHAP
Apr 14 05:55:29 user nova-compute[71312]: node.session.auth.username = TzpPQqJZ
Apr 14 05:55:29 user nova-compute[71312]: node.session.auth.password = ***
Apr 14 05:55:29 user nova-compute[71312]: node.session.auth.username_in = <empty>
Apr 14 05:55:29 user nova-compute[71312]: node.session.auth.password_in = <empty>
Apr 14 05:55:29 user nova-compute[71312]: node.session.auth.chap_algs = MD5
Apr 14 05:55:29 user nova-compute[71312]: node.session.timeo.replacement_timeout = 120
Apr 14 05:55:29 user nova-compute[71312]: node.session.err_timeo.abort_timeout = 15
Apr 14 05:55:29 user nova-compute[71312]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 05:55:29 user nova-compute[71312]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 05:55:29 user nova-compute[71312]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.FastAbort = Yes
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.InitialR2T = No
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.ImmediateData = Yes
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.MaxConnections = 1
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 05:55:29 user nova-compute[71312]: node.session.iscsi.ERL = 0
Apr 14 05:55:29 user nova-compute[71312]: node.session.scan = manual
Apr 14 05:55:29 user nova-compute[71312]: node.session.reopen_max = 0
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].address = 172.16.0.220
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].port = 3260
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].startup = manual
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].tcp.window_size = 524288
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].tcp.type_of_service = 0
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].timeo.logout_timeout = 15
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].timeo.login_timeout = 15
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].timeo.auth_timeout = 45
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].iscsi.DataDigest = None
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].iscsi.IFMarker = No
Apr 14 05:55:29 user nova-compute[71312]: node.conn[0].iscsi.OFMarker = No
Apr 14 05:55:29 user nova-compute[71312]: # END RECORD
Apr 14 05:55:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7b468b-dce1-4a31-a4dc-7e5be377ec95]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a009601-1dcb-4149-b7ae-ce2494f1c1f3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzpPQqJZ {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzpPQqJZ" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46a6b04-950d-4a73-b0d6-09e5e201c424]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzpPQqJZ'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad73e5d-e12b-4e28-98fb-74744478d617]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f6bc8f-531e-450b-ad12-ef4df9207a69]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:29 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:55:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:29 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:55:29 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] HCTL ('36', '0', '0', 0) found on session 22 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b12d432-0de5-4bb7-a92f-55fee5952df1]: (4, ('0 0 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Searching for a device in session 22 and hctl ('36', '0', '0', 0) yield: sde {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzpPQqJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23366313932633264', 'path': '/dev/sde'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366313932633264', 'path': '/dev/sde'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-793349449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-793349449',id=20,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:53:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-ox3x0y2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:53:52Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=46ae7eba-11e8-4a56-b368-739848ed9dbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "vif_mac": "fa:16:3e:a0:32:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "vif_mac": "fa:16:3e:a0:32:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:32:c0,bridge_name='br-int',has_traffic_filtering=True,id=9dfcb341-1a5c-4661-8f34-e559acf931b9,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfcb341-1a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'pci_devices' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:55:29 user nova-compute[71312]:   <uuid>46ae7eba-11e8-4a56-b368-739848ed9dbc</uuid>
Apr 14 05:55:29 user nova-compute[71312]:   <name>instance-00000014</name>
Apr 14 05:55:29 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:55:29 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:55:29 user nova-compute[71312]:   <metadata>
Apr 14 05:55:29 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:55:29 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:55:29 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-793349449</nova:name>
Apr 14 05:55:29 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:55:29</nova:creationTime>
Apr 14 05:55:29 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:55:29 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:55:29 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:55:29 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:55:29 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:55:29 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:55:29 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:55:29 user nova-compute[71312]:       <nova:owner>
Apr 14 05:55:29 user nova-compute[71312]:         <nova:user uuid="c4946885e01a4f0da206d796027b3c9f">tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member</nova:user>
Apr 14 05:55:29 user nova-compute[71312]:         <nova:project uuid="7034e2177823496a861a1601a5c06fe4">tempest-ServerBootFromVolumeStableRescueTest-315541711</nova:project>
Apr 14 05:55:29 user nova-compute[71312]:       </nova:owner>
Apr 14 05:55:29 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:55:29 user nova-compute[71312]:       <nova:ports>
Apr 14 05:55:29 user nova-compute[71312]:         <nova:port uuid="9dfcb341-1a5c-4661-8f34-e559acf931b9">
Apr 14 05:55:29 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 05:55:29 user nova-compute[71312]:         </nova:port>
Apr 14 05:55:29 user nova-compute[71312]:       </nova:ports>
Apr 14 05:55:29 user nova-compute[71312]:     </nova:instance>
Apr 14 05:55:29 user nova-compute[71312]:   </metadata>
Apr 14 05:55:29 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:55:29 user nova-compute[71312]:     <system>
Apr 14 05:55:29 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:55:29 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:55:29 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:55:29 user nova-compute[71312]:       <entry name="serial">46ae7eba-11e8-4a56-b368-739848ed9dbc</entry>
Apr 14 05:55:29 user nova-compute[71312]:       <entry name="uuid">46ae7eba-11e8-4a56-b368-739848ed9dbc</entry>
Apr 14 05:55:29 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:55:29 user nova-compute[71312]:     </system>
Apr 14 05:55:29 user nova-compute[71312]:   </sysinfo>
Apr 14 05:55:29 user nova-compute[71312]:   <os>
Apr 14 05:55:29 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:55:29 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:55:29 user nova-compute[71312]:   </os>
Apr 14 05:55:29 user nova-compute[71312]:   <features>
Apr 14 05:55:29 user nova-compute[71312]:     <acpi/>
Apr 14 05:55:29 user nova-compute[71312]:     <apic/>
Apr 14 05:55:29 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:55:29 user nova-compute[71312]:   </features>
Apr 14 05:55:29 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:55:29 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:55:29 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:55:29 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:55:29 user nova-compute[71312]:   </clock>
Apr 14 05:55:29 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:55:29 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:55:29 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:55:29 user nova-compute[71312]:   </cpu>
Apr 14 05:55:29 user nova-compute[71312]:   <devices>
Apr 14 05:55:29 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:55:29 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:55:29 user nova-compute[71312]:       <source dev="/dev/sde"/>
Apr 14 05:55:29 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:55:29 user nova-compute[71312]:       <serial>d68490bf-7fe3-4500-95a7-4f29aed845f9</serial>
Apr 14 05:55:29 user nova-compute[71312]:     </disk>
Apr 14 05:55:29 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:55:29 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:55:29 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue"/>
Apr 14 05:55:29 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 05:55:29 user nova-compute[71312]:       <boot order="1"/>
Apr 14 05:55:29 user nova-compute[71312]:     </disk>
Apr 14 05:55:29 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:55:29 user nova-compute[71312]:       <mac address="fa:16:3e:a0:32:c0"/>
Apr 14 05:55:29 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:55:29 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:55:29 user nova-compute[71312]:       <target dev="tap9dfcb341-1a"/>
Apr 14 05:55:29 user nova-compute[71312]:     </interface>
Apr 14 05:55:29 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:55:29 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/console.log" append="off"/>
Apr 14 05:55:29 user nova-compute[71312]:     </serial>
Apr 14 05:55:29 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:55:29 user nova-compute[71312]:     <video>
Apr 14 05:55:29 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:55:29 user nova-compute[71312]:     </video>
Apr 14 05:55:29 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:55:29 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:55:29 user nova-compute[71312]:     </rng>
Apr 14 05:55:29 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:55:29 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:55:29 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:55:29 user nova-compute[71312]:     </memballoon>
Apr 14 05:55:29 user nova-compute[71312]:   </devices>
Apr 14 05:55:29 user nova-compute[71312]: </domain>
Apr 14 05:55:29 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:55:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance destroyed successfully.
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No VIF found with MAC fa:16:3e:a0:32:c0, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:55:29 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Took 0.57 seconds to deallocate network for instance.
Apr 14 05:55:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-4fe5e5f8-cf81-45b6-8026-bab4cebac105 req-cac80ace-9979-4e5a-b413-aa7155b635d5 service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-deleted-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:30 user nova-compute[71312]: INFO nova.compute.manager [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Took 0.82 seconds to detach 1 volumes for instance.
Apr 14 05:55:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Deleting volume: adbbc188-4e33-44fe-9723-30a4d276f9e7 {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 05:55:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-unplugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] No waiting events found dispatching network-vif-unplugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:31 user nova-compute[71312]: WARNING nova.compute.manager [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received unexpected event network-vif-unplugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance with vm_state deleted and task_state None.
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Acquiring lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] No waiting events found dispatching network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:31 user nova-compute[71312]: WARNING nova.compute.manager [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Received unexpected event network-vif-plugged-f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance with vm_state deleted and task_state None.
Apr 14 05:55:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-changed-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Refreshing instance network info cache due to event network-changed-98a0c510-de09-47fb-b8cc-7a053b97eb82. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Refreshing network info cache for port 98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:31 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Deleted allocations for instance bf721faf-a8f3-42d6-a980-a49232e383d4
Apr 14 05:55:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "bf721faf-a8f3-42d6-a980-a49232e383d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.192s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updated VIF entry in instance network info cache for port 98a0c510-de09-47fb-b8cc-7a053b97eb82. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:55:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:55:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:33 user nova-compute[71312]: WARNING nova.compute.manager [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state active and task_state rescuing.
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:55:33 user nova-compute[71312]: WARNING nova.compute.manager [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state active and task_state rescuing.
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 46ae7eba-11e8-4a56-b368-739848ed9dbc due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451733.6750844, 46ae7eba-11e8-4a56-b368-739848ed9dbc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:55:33 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] VM Resumed (Lifecycle Event)
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:55:33 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451733.6774027, 46ae7eba-11e8-4a56-b368-739848ed9dbc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:55:33 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] VM Started (Lifecycle Event)
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:55:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:55:33 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 05:55:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:43 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451728.1737266, bf721faf-a8f3-42d6-a980-a49232e383d4 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:55:43 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] VM Stopped (Lifecycle Event)
Apr 14 05:55:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ceea3ea8-cde7-4d9c-9f2e-9f960c367377 None None] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:55:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:45 user nova-compute[71312]: INFO nova.compute.manager [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Detaching volume c444d6ac-de53-4cae-b3d6-7365fbc7c282
Apr 14 05:55:45 user nova-compute[71312]: INFO nova.virt.block_device [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Attempting to driver detach volume c444d6ac-de53-4cae-b3d6-7365fbc7c282 from mountpoint /dev/vdc
Apr 14 05:55:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Attempting to detach device vdc from instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:55:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:55:45 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:55:45 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 05:55:45 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Apr 14 05:55:45 user nova-compute[71312]:   <serial>c444d6ac-de53-4cae-b3d6-7365fbc7c282</serial>
Apr 14 05:55:45 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 05:55:45 user nova-compute[71312]: </disk>
Apr 14 05:55:45 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:55:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully detached device vdc from instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea from the persistent domain config.
Apr 14 05:55:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:55:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:55:45 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:55:45 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 05:55:45 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Apr 14 05:55:45 user nova-compute[71312]:   <serial>c444d6ac-de53-4cae-b3d6-7365fbc7c282</serial>
Apr 14 05:55:45 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 05:55:45 user nova-compute[71312]: </disk>
Apr 14 05:55:45 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451746.0995488, 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:55:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully detached device vdc from instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea from the live domain config.
Apr 14 05:55:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeIwucvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:55:46 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0a8566-0e1e-4e97-b5b2-2066ae6152a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:55:46 user nova-compute[71312]: No targets found.
Apr 14 05:55:46 user nova-compute[71312]: iSNS:
Apr 14 05:55:46 user nova-compute[71312]: No targets found.
Apr 14 05:55:46 user nova-compute[71312]: STATIC:
Apr 14 05:55:46 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282
Apr 14 05:55:46 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:46 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:46 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:55:46 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:55:46 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:55:46 user nova-compute[71312]: FIRMWARE:
Apr 14 05:55:46 user nova-compute[71312]: No targets found.
Apr 14 05:55:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:55:46 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:55:46 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae22268-171e-4890-8bd0-12c9d9b06d03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c9061d-65d9-4c31-8504-e88df55caefc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:46 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:55:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:46 user nova-compute[71312]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 (non-flash)
Apr 14 05:55:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c416d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36611796-1740-421f-b4aa-eecd9909c772]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[747d409c-62d8-413e-bfcb-48ac5d2b3f6f]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a22ce49-98b0-4fdf-9747-fee7c2156c9c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'flavor' on Instance uuid f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a24a36-a73a-4e6f-b95c-7a296e1f1a50]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Ignoring supplied device name: /dev/vdb
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d3fe93-0496-4227-b8fc-6638a3496534]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa3b6a-d2fa-4f75-845d-24a1da85b9b2]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282, portal: 172.16.0.220,3260]
Apr 14 05:55:46 user nova-compute[71312]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282, portal: 172.16.0.220,3260] successful.
Apr 14 05:55:46 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c444d6ac-de53-4cae-b3d6-7365fbc7c282 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d85300-65ea-43ad-9c07-66780bd5995e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] <== disconnect_volume: return (354ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:55:46 user nova-compute[71312]: INFO nova.compute.manager [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Attaching volume 9da702a2-7d93-4521-a579-acc98f437f9b to /dev/vdb
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.utils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb13818b-b4e9-4259-81c6-196a367315ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88862252-bb2d-4b8f-83cd-5d61ca218fb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.042s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1fd025-953f-4aba-9b95-70df843ef660]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[281538a3-ad99-4f64-9803-76b7d13d6316]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:55:46 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:55:46 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69b80dd-a897-4d41-a2e2-79ca133b1e85]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG os_brick.utils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Updating existing volume attachment record: 0f0b2d34-df11-42ca-9707-e74c9965b3ff {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:55:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'flavor' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.897s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbcupfYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:55:51 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:55:51 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:55:51 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb654d1-4ecf-494c-8171-f9879ec90cef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:55:51 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd58ef46-8eb7-4059-9795-7cf237d3afac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b] added
Apr 14 05:55:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aade577-6544-485f-a303-facfc0301353]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[853b5b78-cbdc-4da8-bfea-3aff94324c2b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZbcupfYN {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZbcupfYN" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[448c1855-40f8-4878-b93f-5207de962610]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZbcupfYN'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7761f0b6-6ce4-4a16-b9bc-3fd0282c5ccf]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6711435-3360-471b-9f05-ffbbe6cb9f17]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[52df41da-6576-4757-a2b5-ba97e55c78a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b, portal: 172.16.0.220,3260]
Apr 14 05:55:51 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b, portal: 172.16.0.220,3260] successful.
Apr 14 05:55:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[216b68d3-ab4b-4c50-82c6-524e20cfbd0e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc00ca-6cde-4393-83e5-d983bad30185]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:51 user nova-compute[71312]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b (non-flash)
Apr 14 05:55:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:55:51 user nova-compute[71312]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b (non-flash)
Apr 14 05:55:51 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4aa3b5-ba05-4bf2-8f68-b90bae10433b]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbcupfYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:55:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:55:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23564343062636365', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:55:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564343062636365', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:55:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'flavor' on Instance uuid f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:55:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:55:52 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:55:52 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:55:52 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:55:52 user nova-compute[71312]:   <serial>9da702a2-7d93-4521-a579-acc98f437f9b</serial>
Apr 14 05:55:52 user nova-compute[71312]: </disk>
Apr 14 05:55:52 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:55:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:55:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:55:53 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] No VIF found with MAC fa:16:3e:62:f4:3f, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:55:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.762s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:55:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:55:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:56:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:09 user nova-compute[71312]: INFO nova.compute.manager [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Detaching volume 9da702a2-7d93-4521-a579-acc98f437f9b
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:09 user nova-compute[71312]: INFO nova.virt.block_device [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Attempting to driver detach volume 9da702a2-7d93-4521-a579-acc98f437f9b from mountpoint /dev/vdb
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Attempting to detach device vdb from instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:56:09 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:56:09 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:56:09 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:56:09 user nova-compute[71312]:   <serial>9da702a2-7d93-4521-a579-acc98f437f9b</serial>
Apr 14 05:56:09 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:56:09 user nova-compute[71312]: </disk>
Apr 14 05:56:09 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:56:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Successfully detached device vdb from instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed from the persistent domain config.
Apr 14 05:56:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:56:09 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:56:09 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:56:09 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:56:09 user nova-compute[71312]:   <serial>9da702a2-7d93-4521-a579-acc98f437f9b</serial>
Apr 14 05:56:09 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:56:09 user nova-compute[71312]: </disk>
Apr 14 05:56:09 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451770.239273, f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:56:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Successfully detached device vdb from instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed from the live domain config.
Apr 14 05:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbcupfYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:56:10 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df3b6e-6229-4b85-9559-aee6ab310482]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:56:10 user nova-compute[71312]: No targets found.
Apr 14 05:56:10 user nova-compute[71312]: iSNS:
Apr 14 05:56:10 user nova-compute[71312]: No targets found.
Apr 14 05:56:10 user nova-compute[71312]: STATIC:
Apr 14 05:56:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b
Apr 14 05:56:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:56:10 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:56:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:56:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:56:10 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:56:10 user nova-compute[71312]: FIRMWARE:
Apr 14 05:56:10 user nova-compute[71312]: No targets found.
Apr 14 05:56:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:56:10 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:56:10 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d405ac66-c09c-48c6-908b-28d06e33ede8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1cd3b-3379-4643-a3e2-9fddcd9d1bad]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:56:10 user nova-compute[71312]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b (non-flash)
Apr 14 05:56:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:56:10 user nova-compute[71312]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b (non-flash)
Apr 14 05:56:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c4132a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e72f21-ffb7-48d2-ab9d-28ea7431b57a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[630c7e2f-bdf0-4444-949c-04f3c51b9959]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d4011d-20dc-42e0-8e11-9de2a4838c58]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2577b039-36c0-4636-840a-00dd19013608]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5129ed-f1d2-49ee-9eaf-928f6e699cf9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcc4d9e-5e5e-4168-b734-e441187d9478]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b, portal: 172.16.0.220,3260]
Apr 14 05:56:10 user nova-compute[71312]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b, portal: 172.16.0.220,3260] successful.
Apr 14 05:56:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7480cc17-baf9-4c61-a44a-37a4c7d00b81]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] <== disconnect_volume: return (336ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:56:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8063MB free_disk=26.279151916503906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'flavor' on Instance uuid f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.811s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.720s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Terminating instance
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 88eea6fd-6dde-4692-891e-0587ae62d90c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received event network-vif-unplugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] No waiting events found dispatching network-vif-unplugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received event network-vif-unplugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:56:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Instance destroyed successfully.
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'resources' on Instance uuid f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-105204178',display_name='tempest-VolumesSnapshotTestJSON-instance-105204178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-105204178',id=22,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e242403698514922aad5ec97ae17b1c8',ramdisk_id='',reservation_id='r-kh5jkumn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-186190223',owner_user_name='tempest-VolumesSnapshotTestJSON-186190223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:54:02Z,user_data=None,user_id='92aac6d019db4be3bfe3016653ccc7a0',uuid=f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converting VIF {"id": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "address": "fa:16:3e:62:f4:3f", "network": {"id": "32a1c0e8-4373-44b0-ae89-f5594311013e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-902064520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e242403698514922aad5ec97ae17b1c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaffd2ae-2e", "ovs_interfaceid": "faffd2ae-2e8b-4a66-8121-dfc574aeb634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:3f,bridge_name='br-int',has_traffic_filtering=True,id=faffd2ae-2e8b-4a66-8121-dfc574aeb634,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaffd2ae-2e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_vif [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:3f,bridge_name='br-int',has_traffic_filtering=True,id=faffd2ae-2e8b-4a66-8121-dfc574aeb634,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaffd2ae-2e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfaffd2ae-2e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:12 user nova-compute[71312]: INFO os_vif [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f4:3f,bridge_name='br-int',has_traffic_filtering=True,id=faffd2ae-2e8b-4a66-8121-dfc574aeb634,network=Network(32a1c0e8-4373-44b0-ae89-f5594311013e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaffd2ae-2e')
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZbcupfYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:56:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b095bf-b68d-4642-8658-741d458ede49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:56:12 user nova-compute[71312]: No targets found.
Apr 14 05:56:12 user nova-compute[71312]: iSNS:
Apr 14 05:56:12 user nova-compute[71312]: No targets found.
Apr 14 05:56:12 user nova-compute[71312]: STATIC:
Apr 14 05:56:12 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:56:12 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:56:12 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:56:12 user nova-compute[71312]: FIRMWARE:
Apr 14 05:56:12 user nova-compute[71312]: No targets found.
Apr 14 05:56:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:56:12 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:56:12 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da702a2-7d93-4521-a579-acc98f437f9b', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04debd-2462-4439-839a-e14696781afb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323d84b-377b-43f3-9398-8747add08c90]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:56:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:56:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea220160>, {}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Disconnecting from: [] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] <== disconnect_volume: return (71ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:56:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Deleting instance files /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed_del
Apr 14 05:56:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Deletion of /opt/stack/data/nova/instances/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed_del complete
Apr 14 05:56:12 user nova-compute[71312]: INFO nova.compute.manager [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Took 1.06 seconds to destroy the instance on the hypervisor.
Apr 14 05:56:12 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:56:12 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:56:12 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Took 0.50 seconds to deallocate network for instance.
Apr 14 05:56:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-086c4f3a-7535-4bb5-84d7-c2b15fb4cbd1 req-5f6c554e-3d09-4e01-9321-462e6e25d544 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received event network-vif-deleted-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:13 user nova-compute[71312]: WARNING nova.volume.cinder [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Attachment 0f0b2d34-df11-42ca-9707-e74c9965b3ff does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0f0b2d34-df11-42ca-9707-e74c9965b3ff. (HTTP 404) (Request-ID: req-6a6240ee-bc90-4560-a63f-213a69cc73fa)
Apr 14 05:56:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Took 0.02 seconds to detach 1 volumes for instance.
Apr 14 05:56:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:13 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Deleted allocations for instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed
Apr 14 05:56:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.022s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received event network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] Acquiring lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] Lock "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] No waiting events found dispatching network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:56:13 user nova-compute[71312]: WARNING nova.compute.manager [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Received unexpected event network-vif-plugged-faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance with vm_state deleted and task_state None.
Apr 14 05:56:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:56:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 05:56:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:56:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:56:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "6d4a6a71-954f-4f37-8210-aa86e84828f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:56:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:56:24 user nova-compute[71312]: INFO nova.compute.claims [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Claim successful on node user
Apr 14 05:56:25 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:56:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:56:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:56:25 user nova-compute[71312]: INFO nova.virt.block_device [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Booting with volume 74dc3ebd-bb57-4a6a-be70-a383598ad5ff at /dev/vda
Apr 14 05:56:25 user nova-compute[71312]: DEBUG os_brick.utils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG nova.policy [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bda985-18aa-4b9a-8b9d-4a83d46f0904]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2916e6-3c6c-4686-afb8-86ff29664891]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4f035-5c74-4da1-9f98-4867bd923c19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefbbe27-585e-424d-bb63-a69f494ba64d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:56:25 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:56:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea73ba6-0de9-4ab1-a18f-5524725244ce]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG os_brick.utils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:56:25 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Updating existing volume attachment record: a025a942-6269-4817-b126-1b92b594c1da {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:56:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Successfully created port: 2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Successfully updated port: 2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquired lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received event network-changed-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Refreshing instance network info cache due to event network-changed-2e7c7b93-c896-4047-9b97-306ffada8fe1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] Acquiring lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451772.2859278, f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:56:27 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] VM Stopped (Lifecycle Event)
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-07d96334-423b-4eef-8cf8-c452d10b6488 None None] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Updating instance_info_cache with network_info: [{"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Releasing lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Instance network_info: |[{"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] Acquired lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Refreshing network info cache for port 2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Updated VIF entry in instance network info cache for port 2e7c7b93-c896-4047-9b97-306ffada8fe1. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG nova.network.neutron [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Updating instance_info_cache with network_info: [{"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:56:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] Releasing lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:56:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Creating image(s)
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Ensure instance console log exists: /opt/stack/data/nova/instances/6d4a6a71-954f-4f37-8210-aa86e84828f8/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Start _get_guest_xml network_info=[{"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'a025a942-6269-4817-b126-1b92b594c1da', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJvcdqOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d4a6a71-954f-4f37-8210-aa86e84828f8', 'attached_at': '', 'detached_at': '', 'volume_id': '74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'serial': '74dc3ebd-bb57-4a6a-be70-a383598ad5ff'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:56:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:56:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJvcdqOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:56:30 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:56:30 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:56:30 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b41420-cb10-45ee-9177-ae0bf6cbf3f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:56:30 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac1aa0-e00a-4ff4-9ccb-432e8cbfa05d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff] added
Apr 14 05:56:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c32ecf-cdf5-4be4-b8c3-88dab4adcf11]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3668e26b-7d75-43f9-8f36-344045ca9ccd]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJvcdqOI {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJvcdqOI" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a2b6d-6e10-4fce-a67b-bb211e7c0528]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MJvcdqOI'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4021c7-b1f0-4fa6-8263-e436e130b370]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9dafaa-d94c-407d-a604-d1bd1de4c46d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:56:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:56:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9117d2a3-deb2-488b-9d7d-ce864e4ebc1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260]
Apr 14 05:56:30 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260] successful.
Apr 14 05:56:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dc4e88-a147-421c-8249-cc08e66f57b1]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8cb8f-e3d7-4c0e-8f56-2146e0ccc670]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:56:30 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:56:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:56:30 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:56:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[187aebd0-90bd-477c-9b8a-836b031434aa]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:56:30 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJvcdqOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23764333164363637', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764333164363637', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1162542981',display_name='tempest-TestVolumeBootPattern-server-1162542981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1162542981',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-am2jpoie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:56:25Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=6d4a6a71-954f-4f37-8210-aa86e84828f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ca:b4,bridge_name='br-int',has_traffic_filtering=True,id=2e7c7b93-c896-4047-9b97-306ffada8fe1,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c7b93-c8') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d4a6a71-954f-4f37-8210-aa86e84828f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:56:31 user nova-compute[71312]:   <uuid>6d4a6a71-954f-4f37-8210-aa86e84828f8</uuid>
Apr 14 05:56:31 user nova-compute[71312]:   <name>instance-00000017</name>
Apr 14 05:56:31 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:56:31 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:56:31 user nova-compute[71312]:   <metadata>
Apr 14 05:56:31 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:56:31 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:56:31 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-server-1162542981</nova:name>
Apr 14 05:56:31 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:56:30</nova:creationTime>
Apr 14 05:56:31 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:56:31 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:56:31 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:56:31 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:56:31 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:56:31 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:56:31 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:56:31 user nova-compute[71312]:       <nova:owner>
Apr 14 05:56:31 user nova-compute[71312]:         <nova:user uuid="670c42ab26ab49808773a20f14269e13">tempest-TestVolumeBootPattern-2132265128-project-member</nova:user>
Apr 14 05:56:31 user nova-compute[71312]:         <nova:project uuid="8134d4bfff8e465c8dc0a5342fee7e10">tempest-TestVolumeBootPattern-2132265128</nova:project>
Apr 14 05:56:31 user nova-compute[71312]:       </nova:owner>
Apr 14 05:56:31 user nova-compute[71312]:       <nova:ports>
Apr 14 05:56:31 user nova-compute[71312]:         <nova:port uuid="2e7c7b93-c896-4047-9b97-306ffada8fe1">
Apr 14 05:56:31 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 05:56:31 user nova-compute[71312]:         </nova:port>
Apr 14 05:56:31 user nova-compute[71312]:       </nova:ports>
Apr 14 05:56:31 user nova-compute[71312]:     </nova:instance>
Apr 14 05:56:31 user nova-compute[71312]:   </metadata>
Apr 14 05:56:31 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:56:31 user nova-compute[71312]:     <system>
Apr 14 05:56:31 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:56:31 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:56:31 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:56:31 user nova-compute[71312]:       <entry name="serial">6d4a6a71-954f-4f37-8210-aa86e84828f8</entry>
Apr 14 05:56:31 user nova-compute[71312]:       <entry name="uuid">6d4a6a71-954f-4f37-8210-aa86e84828f8</entry>
Apr 14 05:56:31 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:56:31 user nova-compute[71312]:     </system>
Apr 14 05:56:31 user nova-compute[71312]:   </sysinfo>
Apr 14 05:56:31 user nova-compute[71312]:   <os>
Apr 14 05:56:31 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:56:31 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:56:31 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:56:31 user nova-compute[71312]:   </os>
Apr 14 05:56:31 user nova-compute[71312]:   <features>
Apr 14 05:56:31 user nova-compute[71312]:     <acpi/>
Apr 14 05:56:31 user nova-compute[71312]:     <apic/>
Apr 14 05:56:31 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:56:31 user nova-compute[71312]:   </features>
Apr 14 05:56:31 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:56:31 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:56:31 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:56:31 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:56:31 user nova-compute[71312]:   </clock>
Apr 14 05:56:31 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:56:31 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:56:31 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:56:31 user nova-compute[71312]:   </cpu>
Apr 14 05:56:31 user nova-compute[71312]:   <devices>
Apr 14 05:56:31 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:56:31 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:56:31 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 05:56:31 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:56:31 user nova-compute[71312]:       <serial>74dc3ebd-bb57-4a6a-be70-a383598ad5ff</serial>
Apr 14 05:56:31 user nova-compute[71312]:     </disk>
Apr 14 05:56:31 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:56:31 user nova-compute[71312]:       <mac address="fa:16:3e:25:ca:b4"/>
Apr 14 05:56:31 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:56:31 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:56:31 user nova-compute[71312]:       <target dev="tap2e7c7b93-c8"/>
Apr 14 05:56:31 user nova-compute[71312]:     </interface>
Apr 14 05:56:31 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:56:31 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/6d4a6a71-954f-4f37-8210-aa86e84828f8/console.log" append="off"/>
Apr 14 05:56:31 user nova-compute[71312]:     </serial>
Apr 14 05:56:31 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:56:31 user nova-compute[71312]:     <video>
Apr 14 05:56:31 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:56:31 user nova-compute[71312]:     </video>
Apr 14 05:56:31 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:56:31 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:56:31 user nova-compute[71312]:     </rng>
Apr 14 05:56:31 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:56:31 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:56:31 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:56:31 user nova-compute[71312]:     </memballoon>
Apr 14 05:56:31 user nova-compute[71312]:   </devices>
Apr 14 05:56:31 user nova-compute[71312]: </domain>
Apr 14 05:56:31 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1162542981',display_name='tempest-TestVolumeBootPattern-server-1162542981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1162542981',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-am2jpoie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:56:25Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=6d4a6a71-954f-4f37-8210-aa86e84828f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ca:b4,bridge_name='br-int',has_traffic_filtering=True,id=2e7c7b93-c896-4047-9b97-306ffada8fe1,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c7b93-c8') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG os_vif [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ca:b4,bridge_name='br-int',has_traffic_filtering=True,id=2e7c7b93-c896-4047-9b97-306ffada8fe1,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c7b93-c8') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e7c7b93-c8, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e7c7b93-c8, col_values=(('external_ids', {'iface-id': '2e7c7b93-c896-4047-9b97-306ffada8fe1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:ca:b4', 'vm-uuid': '6d4a6a71-954f-4f37-8210-aa86e84828f8'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:31 user nova-compute[71312]: INFO os_vif [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ca:b4,bridge_name='br-int',has_traffic_filtering=True,id=2e7c7b93-c896-4047-9b97-306ffada8fe1,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c7b93-c8')
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:56:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No VIF found with MAC fa:16:3e:25:ca:b4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:56:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received event network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] Acquiring lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] No waiting events found dispatching network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:56:33 user nova-compute[71312]: WARNING nova.compute.manager [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received unexpected event network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance with vm_state building and task_state spawning.
Apr 14 05:56:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received event network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] Acquiring lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] No waiting events found dispatching network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:56:35 user nova-compute[71312]: WARNING nova.compute.manager [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received unexpected event network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance with vm_state building and task_state spawning.
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451795.5024924, 6d4a6a71-954f-4f37-8210-aa86e84828f8 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:56:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] VM Resumed (Lifecycle Event)
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:56:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Instance spawned successfully.
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:56:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451795.5042832, 6d4a6a71-954f-4f37-8210-aa86e84828f8 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:56:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] VM Started (Lifecycle Event)
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:56:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:56:35 user nova-compute[71312]: INFO nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Took 5.44 seconds to spawn the instance on the hypervisor.
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:56:35 user nova-compute[71312]: INFO nova.compute.manager [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Took 10.99 seconds to build instance.
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.085s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:35 user nova-compute[71312]: INFO nova.compute.manager [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Terminating instance
Apr 14 05:56:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Instance destroyed successfully.
Apr 14 05:56:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'resources' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-553121458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-553121458',id=13,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPD8RR/MXsr73U6E444PVtrgNrPdCCTH4RWjomjXjHxW2wSulD9GhjzDqJBH1L2kZm8JKbhhDzZOX+USbsm/JWzQtiZMhfScVGIoyCJ/BXIUdnRB7W6UoB0Q8LgoWJaYQ==',key_name='tempest-keypair-1417329181',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:54:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-27lzq4z4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=87153a66-bf2c-45f5-aa66-c94eaa6ea7ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "2d2429bd-952a-41bd-8807-48328561c775", "address": "fa:16:3e:6c:a9:eb", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2429bd-95", "ovs_interfaceid": "2d2429bd-952a-41bd-8807-48328561c775", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG os_vif [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d2429bd-95, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: INFO os_vif [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a9:eb,bridge_name='br-int',has_traffic_filtering=True,id=2d2429bd-952a-41bd-8807-48328561c775,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2429bd-95')
Apr 14 05:56:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Deleting instance files /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea_del
Apr 14 05:56:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Deletion of /opt/stack/data/nova/instances/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea_del complete
Apr 14 05:56:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:36 user nova-compute[71312]: INFO nova.compute.manager [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 14 05:56:36 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:56:36 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-unplugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] No waiting events found dispatching network-vif-unplugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-unplugged-2d2429bd-952a-41bd-8807-48328561c775 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Acquiring lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] No waiting events found dispatching network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:56:37 user nova-compute[71312]: WARNING nova.compute.manager [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received unexpected event network-vif-plugged-2d2429bd-952a-41bd-8807-48328561c775 for instance with vm_state active and task_state deleting.
Apr 14 05:56:37 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:56:37 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Took 0.73 seconds to deallocate network for instance.
Apr 14 05:56:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:56:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:56:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:38 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Deleted allocations for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea
Apr 14 05:56:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.235s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:56:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-e3c5e734-233a-4d15-a750-ca3d1819ede4 req-329c7bb7-84f7-4e6f-953e-dcdec0b98401 service nova] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Received event network-vif-deleted-2d2429bd-952a-41bd-8807-48328561c775 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:56:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:56:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 05:56:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 05:56:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 05:56:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:51 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451796.8099687, 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:56:51 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] VM Stopped (Lifecycle Event)
Apr 14 05:56:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-117a6ec2-31fd-411d-a081-fee2e06cd446 None None] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:56:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:56:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:56:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquired lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'info_cache' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating instance_info_cache with network_info: [{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Releasing lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:57:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance destroyed successfully.
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'resources' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG os_vif [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafbb14f2-3c, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:57:04 user nova-compute[71312]: INFO os_vif [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c')
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Start _get_guest_xml network_info=[{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'numa_topology' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:04 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:57:04 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:57:04 user nova-compute[71312]:   <uuid>8bc9e54a-dc25-421f-a380-a394b0867000</uuid>
Apr 14 05:57:04 user nova-compute[71312]:   <name>instance-0000000b</name>
Apr 14 05:57:04 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:57:04 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:57:04 user nova-compute[71312]:   <metadata>
Apr 14 05:57:04 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:57:04 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:57:04 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeTestJSON-server-680332699</nova:name>
Apr 14 05:57:04 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:57:04</nova:creationTime>
Apr 14 05:57:04 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:57:04 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:57:04 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:57:04 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:57:04 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:57:04 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:57:04 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:57:04 user nova-compute[71312]:       <nova:owner>
Apr 14 05:57:04 user nova-compute[71312]:         <nova:user uuid="3aa9911d299b409f9ccc8a55e7b3ec5b">tempest-AttachVolumeTestJSON-1872023683-project-member</nova:user>
Apr 14 05:57:04 user nova-compute[71312]:         <nova:project uuid="5c0f5758b623402393ec9eb273c7ae6f">tempest-AttachVolumeTestJSON-1872023683</nova:project>
Apr 14 05:57:04 user nova-compute[71312]:       </nova:owner>
Apr 14 05:57:04 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:57:04 user nova-compute[71312]:       <nova:ports>
Apr 14 05:57:04 user nova-compute[71312]:         <nova:port uuid="afbb14f2-3ce8-4993-b4cb-40e2c9567067">
Apr 14 05:57:04 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 05:57:04 user nova-compute[71312]:         </nova:port>
Apr 14 05:57:04 user nova-compute[71312]:       </nova:ports>
Apr 14 05:57:04 user nova-compute[71312]:     </nova:instance>
Apr 14 05:57:04 user nova-compute[71312]:   </metadata>
Apr 14 05:57:04 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:57:04 user nova-compute[71312]:     <system>
Apr 14 05:57:04 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:57:04 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:57:04 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:57:04 user nova-compute[71312]:       <entry name="serial">8bc9e54a-dc25-421f-a380-a394b0867000</entry>
Apr 14 05:57:04 user nova-compute[71312]:       <entry name="uuid">8bc9e54a-dc25-421f-a380-a394b0867000</entry>
Apr 14 05:57:04 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:57:04 user nova-compute[71312]:     </system>
Apr 14 05:57:04 user nova-compute[71312]:   </sysinfo>
Apr 14 05:57:04 user nova-compute[71312]:   <os>
Apr 14 05:57:04 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:57:04 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:57:04 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:57:04 user nova-compute[71312]:   </os>
Apr 14 05:57:04 user nova-compute[71312]:   <features>
Apr 14 05:57:04 user nova-compute[71312]:     <acpi/>
Apr 14 05:57:04 user nova-compute[71312]:     <apic/>
Apr 14 05:57:04 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:57:04 user nova-compute[71312]:   </features>
Apr 14 05:57:04 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:57:04 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:57:04 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:57:04 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:57:04 user nova-compute[71312]:   </clock>
Apr 14 05:57:04 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:57:04 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:57:04 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:57:04 user nova-compute[71312]:   </cpu>
Apr 14 05:57:04 user nova-compute[71312]:   <devices>
Apr 14 05:57:04 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:57:04 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:57:04 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk"/>
Apr 14 05:57:04 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:57:04 user nova-compute[71312]:     </disk>
Apr 14 05:57:04 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:57:04 user nova-compute[71312]:       <mac address="fa:16:3e:4c:94:55"/>
Apr 14 05:57:04 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:57:04 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:57:04 user nova-compute[71312]:       <target dev="tapafbb14f2-3c"/>
Apr 14 05:57:04 user nova-compute[71312]:     </interface>
Apr 14 05:57:04 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:57:04 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/console.log" append="off"/>
Apr 14 05:57:04 user nova-compute[71312]:     </serial>
Apr 14 05:57:04 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:57:04 user nova-compute[71312]:     <video>
Apr 14 05:57:04 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:57:04 user nova-compute[71312]:     </video>
Apr 14 05:57:04 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:57:04 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:57:04 user nova-compute[71312]:     </rng>
Apr 14 05:57:04 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:57:04 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:57:04 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:57:04 user nova-compute[71312]:     </memballoon>
Apr 14 05:57:04 user nova-compute[71312]:   </devices>
Apr 14 05:57:04 user nova-compute[71312]: </domain>
Apr 14 05:57:04 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Cannot resize image /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'migration_context' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG os_vif [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafbb14f2-3c, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapafbb14f2-3c, col_values=(('external_ids', {'iface-id': 'afbb14f2-3ce8-4993-b4cb-40e2c9567067', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:94:55', 'vm-uuid': '8bc9e54a-dc25-421f-a380-a394b0867000'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:57:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:05 user nova-compute[71312]: INFO os_vif [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c')
Apr 14 05:57:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:07 user nova-compute[71312]: WARNING nova.compute.manager [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state stopped and task_state powering-on.
Apr 14 05:57:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451829.2579596, 8bc9e54a-dc25-421f-a380-a394b0867000 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:09 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Resumed (Lifecycle Event)
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:57:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance rebooted successfully.
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:09 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451829.259469, 8bc9e54a-dc25-421f-a380-a394b0867000 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:09 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Started (Lifecycle Event)
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:09 user nova-compute[71312]: WARNING nova.compute.manager [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state active and task_state None.
Apr 14 05:57:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:10 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:57:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:57:13 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:57:13 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8096MB free_disk=26.30340576171875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 88eea6fd-6dde-4692-891e-0587ae62d90c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.164s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:57:13 user nova-compute[71312]: INFO nova.compute.claims [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Claim successful on node user
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.network.neutron [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:57:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:57:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.policy [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:57:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Creating image(s)
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "/opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "/opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "/opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.177s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk 1073741824" returned: 0 in 0.052s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Cannot resize image /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'migration_context' on Instance uuid 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.network.neutron [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Successfully created port: 9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Ensure instance console log exists: /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Successfully updated port: 9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquired lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-changed-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Refreshing instance network info cache due to event network-changed-9d24e5dc-5be4-4df3-acba-fb447e4c980a. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] Acquiring lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updating instance_info_cache with network_info: [{"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Releasing lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Instance network_info: |[{"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] Acquired lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.network.neutron [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Refreshing network info cache for port 9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Start _get_guest_xml network_info=[{"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:57:15 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:57:15 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:57:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1652264087',display_name='tempest-TestStampPattern-server-1652264087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1652264087',id=24,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcG2b0c5lB1OTtRptiZOYLsv66c2YAO6Emth1PUn8sXGE4GHBGxeL8wBPcM1Lm0S0rTUfPzymAH0yKo7CcszDhOuQKdNtWzOBHBlEzaLALbxv6+KJBJZLkYLwUsiabyhg==',key_name='tempest-TestStampPattern-1286641636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad1d1e07cab842139c5a42a9f98a0de3',ramdisk_id='',reservation_id='r-6rq2ogam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-43185348',owner_user_name='tempest-TestStampPattern-43185348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:57:14Z,user_data=None,user_id='80e1861ede2547f1b3051829eaef8b7b',uuid=54eb0cb5-4998-4afe-9312-e7a3ea009d05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converting VIF {"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:15 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:8d,bridge_name='br-int',has_traffic_filtering=True,id=9d24e5dc-5be4-4df3-acba-fb447e4c980a,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e5dc-5b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'pci_devices' on Instance uuid 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:57:16 user nova-compute[71312]:   <uuid>54eb0cb5-4998-4afe-9312-e7a3ea009d05</uuid>
Apr 14 05:57:16 user nova-compute[71312]:   <name>instance-00000018</name>
Apr 14 05:57:16 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:57:16 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:57:16 user nova-compute[71312]:   <metadata>
Apr 14 05:57:16 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:57:16 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:57:16 user nova-compute[71312]:       <nova:name>tempest-TestStampPattern-server-1652264087</nova:name>
Apr 14 05:57:16 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:57:15</nova:creationTime>
Apr 14 05:57:16 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:57:16 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:57:16 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:57:16 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:57:16 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:57:16 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:57:16 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:57:16 user nova-compute[71312]:       <nova:owner>
Apr 14 05:57:16 user nova-compute[71312]:         <nova:user uuid="80e1861ede2547f1b3051829eaef8b7b">tempest-TestStampPattern-43185348-project-member</nova:user>
Apr 14 05:57:16 user nova-compute[71312]:         <nova:project uuid="ad1d1e07cab842139c5a42a9f98a0de3">tempest-TestStampPattern-43185348</nova:project>
Apr 14 05:57:16 user nova-compute[71312]:       </nova:owner>
Apr 14 05:57:16 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:57:16 user nova-compute[71312]:       <nova:ports>
Apr 14 05:57:16 user nova-compute[71312]:         <nova:port uuid="9d24e5dc-5be4-4df3-acba-fb447e4c980a">
Apr 14 05:57:16 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 05:57:16 user nova-compute[71312]:         </nova:port>
Apr 14 05:57:16 user nova-compute[71312]:       </nova:ports>
Apr 14 05:57:16 user nova-compute[71312]:     </nova:instance>
Apr 14 05:57:16 user nova-compute[71312]:   </metadata>
Apr 14 05:57:16 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:57:16 user nova-compute[71312]:     <system>
Apr 14 05:57:16 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:57:16 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:57:16 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:57:16 user nova-compute[71312]:       <entry name="serial">54eb0cb5-4998-4afe-9312-e7a3ea009d05</entry>
Apr 14 05:57:16 user nova-compute[71312]:       <entry name="uuid">54eb0cb5-4998-4afe-9312-e7a3ea009d05</entry>
Apr 14 05:57:16 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:57:16 user nova-compute[71312]:     </system>
Apr 14 05:57:16 user nova-compute[71312]:   </sysinfo>
Apr 14 05:57:16 user nova-compute[71312]:   <os>
Apr 14 05:57:16 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:57:16 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:57:16 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:57:16 user nova-compute[71312]:   </os>
Apr 14 05:57:16 user nova-compute[71312]:   <features>
Apr 14 05:57:16 user nova-compute[71312]:     <acpi/>
Apr 14 05:57:16 user nova-compute[71312]:     <apic/>
Apr 14 05:57:16 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:57:16 user nova-compute[71312]:   </features>
Apr 14 05:57:16 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:57:16 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:57:16 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:57:16 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:57:16 user nova-compute[71312]:   </clock>
Apr 14 05:57:16 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:57:16 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:57:16 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:57:16 user nova-compute[71312]:   </cpu>
Apr 14 05:57:16 user nova-compute[71312]:   <devices>
Apr 14 05:57:16 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:57:16 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:57:16 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk"/>
Apr 14 05:57:16 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:57:16 user nova-compute[71312]:     </disk>
Apr 14 05:57:16 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:57:16 user nova-compute[71312]:       <mac address="fa:16:3e:b6:87:8d"/>
Apr 14 05:57:16 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:57:16 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:57:16 user nova-compute[71312]:       <target dev="tap9d24e5dc-5b"/>
Apr 14 05:57:16 user nova-compute[71312]:     </interface>
Apr 14 05:57:16 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:57:16 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/console.log" append="off"/>
Apr 14 05:57:16 user nova-compute[71312]:     </serial>
Apr 14 05:57:16 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:57:16 user nova-compute[71312]:     <video>
Apr 14 05:57:16 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:57:16 user nova-compute[71312]:     </video>
Apr 14 05:57:16 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:57:16 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:57:16 user nova-compute[71312]:     </rng>
Apr 14 05:57:16 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:57:16 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:57:16 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:57:16 user nova-compute[71312]:     </memballoon>
Apr 14 05:57:16 user nova-compute[71312]:   </devices>
Apr 14 05:57:16 user nova-compute[71312]: </domain>
Apr 14 05:57:16 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:57:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1652264087',display_name='tempest-TestStampPattern-server-1652264087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1652264087',id=24,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcG2b0c5lB1OTtRptiZOYLsv66c2YAO6Emth1PUn8sXGE4GHBGxeL8wBPcM1Lm0S0rTUfPzymAH0yKo7CcszDhOuQKdNtWzOBHBlEzaLALbxv6+KJBJZLkYLwUsiabyhg==',key_name='tempest-TestStampPattern-1286641636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad1d1e07cab842139c5a42a9f98a0de3',ramdisk_id='',reservation_id='r-6rq2ogam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-43185348',owner_user_name='tempest-TestStampPattern-43185348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:57:14Z,user_data=None,user_id='80e1861ede2547f1b3051829eaef8b7b',uuid=54eb0cb5-4998-4afe-9312-e7a3ea009d05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converting VIF {"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:8d,bridge_name='br-int',has_traffic_filtering=True,id=9d24e5dc-5be4-4df3-acba-fb447e4c980a,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e5dc-5b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG os_vif [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:8d,bridge_name='br-int',has_traffic_filtering=True,id=9d24e5dc-5be4-4df3-acba-fb447e4c980a,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e5dc-5b') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d24e5dc-5b, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d24e5dc-5b, col_values=(('external_ids', {'iface-id': '9d24e5dc-5be4-4df3-acba-fb447e4c980a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:87:8d', 'vm-uuid': '54eb0cb5-4998-4afe-9312-e7a3ea009d05'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:16 user nova-compute[71312]: INFO os_vif [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:8d,bridge_name='br-int',has_traffic_filtering=True,id=9d24e5dc-5be4-4df3-acba-fb447e4c980a,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e5dc-5b')
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No VIF found with MAC fa:16:3e:b6:87:8d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.network.neutron [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updated VIF entry in instance network info cache for port 9d24e5dc-5be4-4df3-acba-fb447e4c980a. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.network.neutron [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updating instance_info_cache with network_info: [{"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] Releasing lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:57:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:17 user nova-compute[71312]: INFO nova.compute.manager [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Unrescuing
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquired lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating instance_info_cache with network_info: [{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Releasing lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'flavor' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] No waiting events found dispatching network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:17 user nova-compute[71312]: WARNING nova.compute.manager [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received unexpected event network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance with vm_state building and task_state spawning.
Apr 14 05:57:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Skipping network cache update for instance because it is Building. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:57:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:18 user nova-compute[71312]: WARNING nova.compute.manager [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance destroyed successfully.
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating instance_info_cache with network_info: [{"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-8bc9e54a-dc25-421f-a380-a394b0867000" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] No waiting events found dispatching network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:19 user nova-compute[71312]: WARNING nova.compute.manager [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received unexpected event network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance with vm_state building and task_state spawning.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:20 user nova-compute[71312]: WARNING nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:20 user nova-compute[71312]: WARNING nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:20 user nova-compute[71312]: WARNING nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:20 user nova-compute[71312]: WARNING nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:20 user nova-compute[71312]: WARNING nova.compute.manager [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451840.1314685, 54eb0cb5-4998-4afe-9312-e7a3ea009d05 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] VM Resumed (Lifecycle Event)
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:57:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Instance spawned successfully.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451840.1344168, 54eb0cb5-4998-4afe-9312-e7a3ea009d05 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] VM Started (Lifecycle Event)
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:20 user nova-compute[71312]: INFO nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Took 6.25 seconds to spawn the instance on the hypervisor.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:20 user nova-compute[71312]: INFO nova.compute.manager [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Took 7.07 seconds to build instance.
Apr 14 05:57:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.200s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:22 user nova-compute[71312]: WARNING nova.compute.manager [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:22 user nova-compute[71312]: WARNING nova.compute.manager [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state rescued and task_state unrescuing.
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 46ae7eba-11e8-4a56-b368-739848ed9dbc due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451842.4668562, 46ae7eba-11e8-4a56-b368-739848ed9dbc => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:22 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] VM Resumed (Lifecycle Event)
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:22 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451842.467856, 46ae7eba-11e8-4a56-b368-739848ed9dbc => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:22 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] VM Started (Lifecycle Event)
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'flavor' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:25 user nova-compute[71312]: INFO nova.compute.manager [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attaching volume c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a to /dev/vdb
Apr 14 05:57:25 user nova-compute[71312]: DEBUG os_brick.utils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c1af8d-7c27-4fe8-af48-30f8e3c5f357]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b81bf6-8a11-444b-974d-e31112541024]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[709a162d-162d-4c90-8c6e-acf5edc9ccd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbdf79e-554b-4da8-a7bd-5b2b5b9624a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:57:25 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:57:25 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c656a91-f819-4ae0-9732-e299d1c69b26]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG os_brick.utils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:57:25 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating existing volume attachment record: f311574f-cf01-4b0f-a00d-ba6414e618bc {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:57:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:57:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:57:29 user nova-compute[71312]: INFO nova.compute.claims [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Claim successful on node user
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:57:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.policy [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:57:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Creating image(s)
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnDXwzQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:57:30 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:57:30 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:57:30 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b3c60-a34b-4b6b-a52d-cb9b83c426bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:57:30 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5127edb-58b3-49e6-b1c8-554f1365b89e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a] added
Apr 14 05:57:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab37c78-d22e-4c30-b1e8-2f58ea5f90ad]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk 1073741824" returned: 0 in 0.054s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc83b748-2404-4ea9-9e8b-a482b09d1e42]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnDXwzQP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnDXwzQP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef552f0-71e9-4c82-a0d6-905f5b67fa2b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnDXwzQP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc4071e-d776-40fb-870e-4d1706387aef]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda9d7e-f197-4404-a36d-06f4c4978cb3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:30 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:30 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:30 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:57:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6dbcc2-5700-4cf7-9322-34b8c91003fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260]
Apr 14 05:57:31 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260] successful.
Apr 14 05:57:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccab355c-eb07-44d8-89b4-de4221835dec]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c1c7d1-ad86-4ac5-b8bf-b6f713776f70]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:31 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:31 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:57:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:31 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:31 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:57:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6454228c-f0d2-47f7-bc6e-b17f81ceeea2]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnDXwzQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Cannot resize image /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'migration_context' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Ensure instance console log exists: /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Successfully created port: 164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:57:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Successfully updated port: 164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquired lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-changed-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Refreshing instance network info cache due to event network-changed-164b82d4-a91d-462e-9018-d6ef229e6aec. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] Acquiring lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '26430343438363431', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430343438363431', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'flavor' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:57:32 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:57:32 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 05:57:32 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:57:32 user nova-compute[71312]:   <serial>c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a</serial>
Apr 14 05:57:32 user nova-compute[71312]: </disk>
Apr 14 05:57:32 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating instance_info_cache with network_info: [{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Releasing lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance network_info: |[{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] Acquired lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Refreshing network info cache for port 164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Start _get_guest_xml network_info=[{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:57:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:57:32 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1479627857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1479627857',id=25,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj45WaFx8qIhjQPabhfxsWHA1PKIKKwtfrQJR3MqBpiqoCGN6x1pQ48FY1HRxszOWvQ149S+9eT9WsV7wUAXKXME2zAw5wX99IzrhcOJC2qmHxSZPdB5oJ1T5winHfSMw==',key_name='tempest-keypair-281561404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-0fh0slm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=b7f31928-32b3-4d1e-bb7c-7b4799ce6439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'pci_devices' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:57:32 user nova-compute[71312]:   <uuid>b7f31928-32b3-4d1e-bb7c-7b4799ce6439</uuid>
Apr 14 05:57:32 user nova-compute[71312]:   <name>instance-00000019</name>
Apr 14 05:57:32 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:57:32 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:57:32 user nova-compute[71312]:   <metadata>
Apr 14 05:57:32 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:57:32 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:57:32 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1479627857</nova:name>
Apr 14 05:57:32 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:57:32</nova:creationTime>
Apr 14 05:57:32 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:57:32 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:57:32 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:57:32 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:57:32 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:57:32 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:57:32 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:57:32 user nova-compute[71312]:       <nova:owner>
Apr 14 05:57:32 user nova-compute[71312]:         <nova:user uuid="e7fece08f6f649bb89fc8ae5121bc2cc">tempest-AttachVolumeShelveTestJSON-1611001218-project-member</nova:user>
Apr 14 05:57:32 user nova-compute[71312]:         <nova:project uuid="a335a6c17041473ca2abf256cb30a25f">tempest-AttachVolumeShelveTestJSON-1611001218</nova:project>
Apr 14 05:57:32 user nova-compute[71312]:       </nova:owner>
Apr 14 05:57:32 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:57:32 user nova-compute[71312]:       <nova:ports>
Apr 14 05:57:32 user nova-compute[71312]:         <nova:port uuid="164b82d4-a91d-462e-9018-d6ef229e6aec">
Apr 14 05:57:32 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 05:57:32 user nova-compute[71312]:         </nova:port>
Apr 14 05:57:32 user nova-compute[71312]:       </nova:ports>
Apr 14 05:57:32 user nova-compute[71312]:     </nova:instance>
Apr 14 05:57:32 user nova-compute[71312]:   </metadata>
Apr 14 05:57:32 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:57:32 user nova-compute[71312]:     <system>
Apr 14 05:57:32 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:57:32 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:57:32 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:57:32 user nova-compute[71312]:       <entry name="serial">b7f31928-32b3-4d1e-bb7c-7b4799ce6439</entry>
Apr 14 05:57:32 user nova-compute[71312]:       <entry name="uuid">b7f31928-32b3-4d1e-bb7c-7b4799ce6439</entry>
Apr 14 05:57:32 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:57:32 user nova-compute[71312]:     </system>
Apr 14 05:57:32 user nova-compute[71312]:   </sysinfo>
Apr 14 05:57:32 user nova-compute[71312]:   <os>
Apr 14 05:57:32 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:57:32 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:57:32 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:57:32 user nova-compute[71312]:   </os>
Apr 14 05:57:32 user nova-compute[71312]:   <features>
Apr 14 05:57:32 user nova-compute[71312]:     <acpi/>
Apr 14 05:57:32 user nova-compute[71312]:     <apic/>
Apr 14 05:57:32 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:57:32 user nova-compute[71312]:   </features>
Apr 14 05:57:32 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:57:32 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:57:32 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:57:32 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:57:32 user nova-compute[71312]:   </clock>
Apr 14 05:57:32 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:57:32 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:57:32 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:57:32 user nova-compute[71312]:   </cpu>
Apr 14 05:57:32 user nova-compute[71312]:   <devices>
Apr 14 05:57:32 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:57:32 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:57:32 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk"/>
Apr 14 05:57:32 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:57:32 user nova-compute[71312]:     </disk>
Apr 14 05:57:32 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:57:32 user nova-compute[71312]:       <mac address="fa:16:3e:95:73:6e"/>
Apr 14 05:57:32 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:57:32 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:57:32 user nova-compute[71312]:       <target dev="tap164b82d4-a9"/>
Apr 14 05:57:32 user nova-compute[71312]:     </interface>
Apr 14 05:57:32 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:57:32 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/console.log" append="off"/>
Apr 14 05:57:32 user nova-compute[71312]:     </serial>
Apr 14 05:57:32 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:57:32 user nova-compute[71312]:     <video>
Apr 14 05:57:32 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:57:32 user nova-compute[71312]:     </video>
Apr 14 05:57:32 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:57:32 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:57:32 user nova-compute[71312]:     </rng>
Apr 14 05:57:32 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:57:32 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:57:32 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:57:32 user nova-compute[71312]:     </memballoon>
Apr 14 05:57:32 user nova-compute[71312]:   </devices>
Apr 14 05:57:32 user nova-compute[71312]: </domain>
Apr 14 05:57:32 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1479627857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1479627857',id=25,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj45WaFx8qIhjQPabhfxsWHA1PKIKKwtfrQJR3MqBpiqoCGN6x1pQ48FY1HRxszOWvQ149S+9eT9WsV7wUAXKXME2zAw5wX99IzrhcOJC2qmHxSZPdB5oJ1T5winHfSMw==',key_name='tempest-keypair-281561404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-0fh0slm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=b7f31928-32b3-4d1e-bb7c-7b4799ce6439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG os_vif [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap164b82d4-a9, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap164b82d4-a9, col_values=(('external_ids', {'iface-id': '164b82d4-a91d-462e-9018-d6ef229e6aec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:73:6e', 'vm-uuid': 'b7f31928-32b3-4d1e-bb7c-7b4799ce6439'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:32 user nova-compute[71312]: INFO os_vif [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9')
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No VIF found with MAC fa:16:3e:6e:2e:0e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No VIF found with MAC fa:16:3e:95:73:6e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:57:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.295s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updated VIF entry in instance network info cache for port 164b82d4-a91d-462e-9018-d6ef229e6aec. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:57:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating instance_info_cache with network_info: [{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:57:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] Releasing lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:57:34 user nova-compute[71312]: INFO nova.compute.manager [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Rebuilding instance
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_requests' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'resources' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'migration_context' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71312) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:34 user nova-compute[71312]: WARNING nova.compute.manager [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state rebuilding.
Apr 14 05:57:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance destroyed successfully.
Apr 14 05:57:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Detaching volume c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a
Apr 14 05:57:35 user nova-compute[71312]: INFO nova.virt.block_device [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attempting to driver detach volume c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a from mountpoint /dev/vdb
Apr 14 05:57:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Attempting to detach device vdb from instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:57:35 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:57:35 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 05:57:35 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:57:35 user nova-compute[71312]:   <serial>c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a</serial>
Apr 14 05:57:35 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:57:35 user nova-compute[71312]: </disk>
Apr 14 05:57:35 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:57:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully detached device vdb from instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 from the persistent domain config.
Apr 14 05:57:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnDXwzQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:57:35 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2899b7-5a6a-47ff-a994-7db3ca44011e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:57:35 user nova-compute[71312]: No targets found.
Apr 14 05:57:35 user nova-compute[71312]: iSNS:
Apr 14 05:57:35 user nova-compute[71312]: No targets found.
Apr 14 05:57:35 user nova-compute[71312]: STATIC:
Apr 14 05:57:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 05:57:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:57:35 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:57:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:57:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:57:35 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:57:35 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a
Apr 14 05:57:35 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:57:35 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:57:35 user nova-compute[71312]: FIRMWARE:
Apr 14 05:57:35 user nova-compute[71312]: No targets found.
Apr 14 05:57:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:57:35 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:57:35 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df583fd-b2af-48d7-8f3d-90ce5027968c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[25757283-bd4c-4c3f-8515-036e78e8fa6b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:35 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:35 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:57:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:35 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:35 user nova-compute[71312]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:57:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea220820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc3ca9d-809d-44c8-9995-00e577f350eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea2ca32-12c8-4aa5-ad0d-d2ba8a3ab31f]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36561bfe-3c1c-477e-a0c3-6f6c403158f7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b4018b-2942-4b3a-96e5-681c59bec8d3]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17733d10-cfbb-4551-88b7-778a5afab113]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfbd49a-8fb6-48d5-ab2c-7bcc2145e5e8]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260]
Apr 14 05:57:35 user nova-compute[71312]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260] successful.
Apr 14 05:57:35 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b089f4-3284-482d-9f66-efb1f3220829]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== disconnect_volume: return (334ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:57:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:57:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance destroyed successfully.
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_vif [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98a0c510-de, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:57:36 user nova-compute[71312]: INFO os_vif [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de')
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnDXwzQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:57:36 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5fb85-5cb0-427c-82ed-5d87e52890b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:57:36 user nova-compute[71312]: No targets found.
Apr 14 05:57:36 user nova-compute[71312]: iSNS:
Apr 14 05:57:36 user nova-compute[71312]: No targets found.
Apr 14 05:57:36 user nova-compute[71312]: STATIC:
Apr 14 05:57:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 05:57:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:57:36 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:57:36 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:57:36 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:57:36 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:57:36 user nova-compute[71312]: FIRMWARE:
Apr 14 05:57:36 user nova-compute[71312]: No targets found.
Apr 14 05:57:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:57:36 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:57:36 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2b8f65-c78e-4882-af24-8f76c0623b6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a380835a-1bb9-43cf-9fb6-f123892da459]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:36 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:36 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:36 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c416fd00>, {}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Disconnecting from: [] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== disconnect_volume: return (69ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:57:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Deleting instance files /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187_del
Apr 14 05:57:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Deletion of /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187_del complete
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:36 user nova-compute[71312]: WARNING nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state rebuilding.
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:36 user nova-compute[71312]: WARNING nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state building and task_state spawning.
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:36 user nova-compute[71312]: WARNING nova.compute.manager [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state building and task_state spawning.
Apr 14 05:57:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:36 user nova-compute[71312]: INFO nova.virt.block_device [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Booting with volume c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a at /dev/vdb
Apr 14 05:57:36 user nova-compute[71312]: DEBUG os_brick.utils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:36 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6ec51c-554a-44f0-b994-05920aad28bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbea0b5f-1e16-4a93-94d9-f99a61bcad9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cb731d-e0e3-4b3e-aecd-bd49d86406f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a358c64-c04a-4295-b1cf-233f4df6682a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:57:37 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a98c7ed-ee19-493a-ba49-d6a11fd822fa]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG os_brick.utils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating existing volume attachment record: e68eabb0-f7f4-4be9-89a7-45d670362a78 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451857.1868205, b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:37 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] VM Resumed (Lifecycle Event)
Apr 14 05:57:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance spawned successfully.
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:37 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451857.1873477, b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:37 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] VM Started (Lifecycle Event)
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:37 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:57:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Took 6.80 seconds to spawn the instance on the hypervisor.
Apr 14 05:57:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:37 user nova-compute[71312]: INFO nova.compute.manager [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Took 7.54 seconds to build instance.
Apr 14 05:57:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.659s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:57:42 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Creating image(s)
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk 1073741824" returned: 0 in 0.054s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Cannot resize image /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Ensure instance console log exists: /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Start _get_guest_xml network_info=[{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'e68eabb0-f7f4-4be9-89a7-45d670362a78', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnDXwzQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'serial': 'c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:57:42 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 05:57:42 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnDXwzQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:57:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:57:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:57:42 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f8dc9a-5c05-49ae-967d-89421a87254a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:57:42 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cc6f38-b2a5-48e1-961a-1fab841c3232]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a] added
Apr 14 05:57:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44bab8f-4bc4-44eb-8f57-da7d4056ee92]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a50879-97c3-421e-9fe3-e8aeb697ffe7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnDXwzQP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnDXwzQP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[14df5aa2-e631-4e10-bda9-6732b2f452f7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnDXwzQP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c428a383-fc75-4e54-a14f-38cd2edcf2bd]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab8b863-67d2-4919-8d73-52357208288c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:42 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:42 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e9ffd-92ea-4548-acfc-ec07e6c0ffe3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260]
Apr 14 05:57:42 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260] successful.
Apr 14 05:57:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6948ed-7f4f-47fa-8c41-81861157050c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf16385-54de-47fb-adeb-24a278fbe931]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:43 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:43 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:57:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:57:43 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:57:43 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:57:43 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef490fc-cf49-403c-bc4b-f8ba5efc583f]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:57:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnDXwzQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26430343438363431', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430343438363431', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:57:44 user nova-compute[71312]:   <uuid>4e8ac55a-5fe7-470b-b04e-97a9f00f3187</uuid>
Apr 14 05:57:44 user nova-compute[71312]:   <name>instance-00000015</name>
Apr 14 05:57:44 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:57:44 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:57:44 user nova-compute[71312]:   <metadata>
Apr 14 05:57:44 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:57:44 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:57:44 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestJSON-server-1862725483</nova:name>
Apr 14 05:57:44 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:57:42</nova:creationTime>
Apr 14 05:57:44 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:57:44 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:57:44 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:57:44 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:57:44 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:57:44 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:57:44 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:57:44 user nova-compute[71312]:       <nova:owner>
Apr 14 05:57:44 user nova-compute[71312]:         <nova:user uuid="290b67b22a91443fbfc829fa4e3db036">tempest-ServerActionsTestJSON-31064769-project-member</nova:user>
Apr 14 05:57:44 user nova-compute[71312]:         <nova:project uuid="dbc4321a7868464faa59341018ed747f">tempest-ServerActionsTestJSON-31064769</nova:project>
Apr 14 05:57:44 user nova-compute[71312]:       </nova:owner>
Apr 14 05:57:44 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:57:44 user nova-compute[71312]:       <nova:ports>
Apr 14 05:57:44 user nova-compute[71312]:         <nova:port uuid="98a0c510-de09-47fb-b8cc-7a053b97eb82">
Apr 14 05:57:44 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 05:57:44 user nova-compute[71312]:         </nova:port>
Apr 14 05:57:44 user nova-compute[71312]:       </nova:ports>
Apr 14 05:57:44 user nova-compute[71312]:     </nova:instance>
Apr 14 05:57:44 user nova-compute[71312]:   </metadata>
Apr 14 05:57:44 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:57:44 user nova-compute[71312]:     <system>
Apr 14 05:57:44 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:57:44 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:57:44 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:57:44 user nova-compute[71312]:       <entry name="serial">4e8ac55a-5fe7-470b-b04e-97a9f00f3187</entry>
Apr 14 05:57:44 user nova-compute[71312]:       <entry name="uuid">4e8ac55a-5fe7-470b-b04e-97a9f00f3187</entry>
Apr 14 05:57:44 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:57:44 user nova-compute[71312]:     </system>
Apr 14 05:57:44 user nova-compute[71312]:   </sysinfo>
Apr 14 05:57:44 user nova-compute[71312]:   <os>
Apr 14 05:57:44 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:57:44 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:57:44 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:57:44 user nova-compute[71312]:   </os>
Apr 14 05:57:44 user nova-compute[71312]:   <features>
Apr 14 05:57:44 user nova-compute[71312]:     <acpi/>
Apr 14 05:57:44 user nova-compute[71312]:     <apic/>
Apr 14 05:57:44 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:57:44 user nova-compute[71312]:   </features>
Apr 14 05:57:44 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:57:44 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:57:44 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:57:44 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:57:44 user nova-compute[71312]:   </clock>
Apr 14 05:57:44 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:57:44 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:57:44 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:57:44 user nova-compute[71312]:   </cpu>
Apr 14 05:57:44 user nova-compute[71312]:   <devices>
Apr 14 05:57:44 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:57:44 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:57:44 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk"/>
Apr 14 05:57:44 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:57:44 user nova-compute[71312]:     </disk>
Apr 14 05:57:44 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:57:44 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:57:44 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Apr 14 05:57:44 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 05:57:44 user nova-compute[71312]:       <serial>c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a</serial>
Apr 14 05:57:44 user nova-compute[71312]:     </disk>
Apr 14 05:57:44 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:57:44 user nova-compute[71312]:       <mac address="fa:16:3e:6e:2e:0e"/>
Apr 14 05:57:44 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:57:44 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:57:44 user nova-compute[71312]:       <target dev="tap98a0c510-de"/>
Apr 14 05:57:44 user nova-compute[71312]:     </interface>
Apr 14 05:57:44 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:57:44 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/console.log" append="off"/>
Apr 14 05:57:44 user nova-compute[71312]:     </serial>
Apr 14 05:57:44 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:57:44 user nova-compute[71312]:     <video>
Apr 14 05:57:44 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:57:44 user nova-compute[71312]:     </video>
Apr 14 05:57:44 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:57:44 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:57:44 user nova-compute[71312]:     </rng>
Apr 14 05:57:44 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:57:44 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:57:44 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:57:44 user nova-compute[71312]:     </memballoon>
Apr 14 05:57:44 user nova-compute[71312]:   </devices>
Apr 14 05:57:44 user nova-compute[71312]: </domain>
Apr 14 05:57:44 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG os_vif [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98a0c510-de, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98a0c510-de, col_values=(('external_ids', {'iface-id': '98a0c510-de09-47fb-b8cc-7a053b97eb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2e:0e', 'vm-uuid': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:44 user nova-compute[71312]: INFO os_vif [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de')
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:57:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No VIF found with MAC fa:16:3e:6e:2e:0e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:57:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:45 user nova-compute[71312]: WARNING nova.compute.manager [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 05:57:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451867.5251622, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Resumed (Lifecycle Event)
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:57:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance spawned successfully.
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451867.5262768, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:57:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Started (Lifecycle Event)
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:57:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:57:47 user nova-compute[71312]: WARNING nova.compute.manager [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 05:57:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71312) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 05:57:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:57:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:57:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:10 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:58:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:58:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:58:13 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:58:13 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7928MB free_disk=26.259044647216797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8bc9e54a-dc25-421f-a380-a394b0867000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 88eea6fd-6dde-4692-891e-0587ae62d90c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:58:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:58:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received event network-changed-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Refreshing instance network info cache due to event network-changed-2e7c7b93-c896-4047-9b97-306ffada8fe1. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] Acquiring lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] Acquired lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG nova.network.neutron [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Refreshing network info cache for port 2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "6d4a6a71-954f-4f37-8210-aa86e84828f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:16 user nova-compute[71312]: INFO nova.compute.manager [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Terminating instance
Apr 14 05:58:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:58:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received event network-vif-unplugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] Acquiring lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] No waiting events found dispatching network-vif-unplugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received event network-vif-unplugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.network.neutron [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Updated VIF entry in instance network info cache for port 2e7c7b93-c896-4047-9b97-306ffada8fe1. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.network.neutron [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Updating instance_info_cache with network_info: [{"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] Releasing lock "refresh_cache-6d4a6a71-954f-4f37-8210-aa86e84828f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:58:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Instance destroyed successfully.
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'resources' on Instance uuid 6d4a6a71-954f-4f37-8210-aa86e84828f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1162542981',display_name='tempest-TestVolumeBootPattern-server-1162542981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1162542981',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:56:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-am2jpoie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:56:36Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=6d4a6a71-954f-4f37-8210-aa86e84828f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "address": "fa:16:3e:25:ca:b4", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e7c7b93-c8", "ovs_interfaceid": "2e7c7b93-c896-4047-9b97-306ffada8fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ca:b4,bridge_name='br-int',has_traffic_filtering=True,id=2e7c7b93-c896-4047-9b97-306ffada8fe1,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c7b93-c8') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_vif [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ca:b4,bridge_name='br-int',has_traffic_filtering=True,id=2e7c7b93-c896-4047-9b97-306ffada8fe1,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c7b93-c8') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e7c7b93-c8, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:58:17 user nova-compute[71312]: INFO os_vif [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ca:b4,bridge_name='br-int',has_traffic_filtering=True,id=2e7c7b93-c896-4047-9b97-306ffada8fe1,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e7c7b93-c8')
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJvcdqOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:58:17 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c177b769-7b42-48f9-8486-b1ebf87325da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:58:17 user nova-compute[71312]: No targets found.
Apr 14 05:58:17 user nova-compute[71312]: iSNS:
Apr 14 05:58:17 user nova-compute[71312]: No targets found.
Apr 14 05:58:17 user nova-compute[71312]: STATIC:
Apr 14 05:58:17 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 05:58:17 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:58:17 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:58:17 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:58:17 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:58:17 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:58:17 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a
Apr 14 05:58:17 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:58:17 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:58:17 user nova-compute[71312]: FIRMWARE:
Apr 14 05:58:17 user nova-compute[71312]: No targets found.
Apr 14 05:58:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:58:17 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:58:17 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0acf70-5e8a-46d9-b1cf-03fe84c42049]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a911947-056e-4c3c-a2d6-4a6b6b14a91d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:58:17 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:58:17 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:58:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:58:17 user nova-compute[71312]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:58:17 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:58:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c42a7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c8a0ec-f32b-4b48-8475-282ce8bd5768]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9728564-3c71-4987-8044-ef8415545342]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36aebf9d-3fc1-48f6-bff5-0549f866773c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c284b13-4a15-48c4-842b-36dd9d1e903f]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd9a58f-7de7-4481-8bd3-554ab4fee336]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab7eff0-8119-4f1f-82b0-20ad1c9f8137]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260]
Apr 14 05:58:17 user nova-compute[71312]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260] successful.
Apr 14 05:58:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:58:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1209172-97d0-403a-8111-f2ea692cb000]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== disconnect_volume: return (318ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:58:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Deleting instance files /opt/stack/data/nova/instances/6d4a6a71-954f-4f37-8210-aa86e84828f8_del
Apr 14 05:58:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Deletion of /opt/stack/data/nova/instances/6d4a6a71-954f-4f37-8210-aa86e84828f8_del complete
Apr 14 05:58:18 user nova-compute[71312]: INFO nova.compute.manager [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 05:58:18 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updating instance_info_cache with network_info: [{"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:58:18 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:58:18 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Took 0.85 seconds to deallocate network for instance.
Apr 14 05:58:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-de8bcbbe-a835-49fb-9080-ba61d2d81dde req-183fdbd1-854f-4dc3-8830-c91f6f9f385e service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received event network-vif-deleted-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:58:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:58:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received event network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:58:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] Acquiring lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] No waiting events found dispatching network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:58:19 user nova-compute[71312]: WARNING nova.compute.manager [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Received unexpected event network-vif-plugged-2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance with vm_state active and task_state deleting.
Apr 14 05:58:19 user nova-compute[71312]: INFO nova.compute.manager [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Took 0.79 seconds to detach 1 volumes for instance.
Apr 14 05:58:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:20 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:58:20 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:58:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:20 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Deleted allocations for instance 6d4a6a71-954f-4f37-8210-aa86e84828f8
Apr 14 05:58:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "6d4a6a71-954f-4f37-8210-aa86e84828f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.264s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:32 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451897.6489172, 6d4a6a71-954f-4f37-8210-aa86e84828f8 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:58:32 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] VM Stopped (Lifecycle Event)
Apr 14 05:58:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83be1a67-c6d2-4ccc-ac87-46e5aebe4725 None None] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:58:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:58:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:58:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:55 user nova-compute[71312]: INFO nova.compute.manager [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Terminating instance
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-unplugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 05:58:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Instance destroyed successfully.
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'resources' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-680332699',display_name='tempest-AttachVolumeTestJSON-server-680332699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-680332699',id=11,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw==',key_name='tempest-keypair-435197988',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-560x2gjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:57:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=8bc9e54a-dc25-421f-a380-a394b0867000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "address": "fa:16:3e:4c:94:55", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbb14f2-3c", "ovs_interfaceid": "afbb14f2-3ce8-4993-b4cb-40e2c9567067", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG os_vif [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafbb14f2-3c, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:58:55 user nova-compute[71312]: INFO os_vif [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:94:55,bridge_name='br-int',has_traffic_filtering=True,id=afbb14f2-3ce8-4993-b4cb-40e2c9567067,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafbb14f2-3c')
Apr 14 05:58:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Deleting instance files /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000_del
Apr 14 05:58:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Deletion of /opt/stack/data/nova/instances/8bc9e54a-dc25-421f-a380-a394b0867000_del complete
Apr 14 05:58:55 user nova-compute[71312]: INFO nova.compute.manager [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 05:58:55 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 05:58:55 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 05:58:56 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:58:56 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Took 0.95 seconds to deallocate network for instance.
Apr 14 05:58:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:58:57 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:58:57 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:58:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:57 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Deleted allocations for instance 8bc9e54a-dc25-421f-a380-a394b0867000
Apr 14 05:58:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "8bc9e54a-dc25-421f-a380-a394b0867000" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:58:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Acquiring lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:58:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:58:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Lock "8bc9e54a-dc25-421f-a380-a394b0867000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:58:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] No waiting events found dispatching network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:58:57 user nova-compute[71312]: WARNING nova.compute.manager [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received unexpected event network-vif-plugged-afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance with vm_state deleted and task_state None.
Apr 14 05:58:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Received event network-vif-deleted-afbb14f2-3ce8-4993-b4cb-40e2c9567067 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-changed-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Refreshing instance network info cache due to event network-changed-9d24e5dc-5be4-4df3-acba-fb447e4c980a. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] Acquiring lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] Acquired lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG nova.network.neutron [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Refreshing network info cache for port 9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'flavor' on Instance uuid 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:05 user nova-compute[71312]: INFO nova.compute.manager [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Attaching volume 759ab340-42b3-420f-b44c-c4dd4ec6e190 to /dev/vdb
Apr 14 05:59:05 user nova-compute[71312]: DEBUG os_brick.utils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7530fdf-5fe5-46dc-b216-06aa557384fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8355fe23-81bd-4c02-921a-01fe9c2e5598]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ab6f73-d49b-40ae-b357-274b4a9982bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG nova.network.neutron [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updated VIF entry in instance network info cache for port 9d24e5dc-5be4-4df3-acba-fb447e4c980a. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG nova.network.neutron [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updating instance_info_cache with network_info: [{"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b380b9-7bcb-42d9-98c0-debad1c0c807]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] Releasing lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:59:05 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:59:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d00d8b-9a43-470e-a1a3-7f5129124220]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG os_brick.utils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updating existing volume attachment record: 2074cbf2-fff6-42df-9f9f-89d08baab26a {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:59:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "d8995825-7362-44ef-87b2-33c1f9f02e56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:59:08 user nova-compute[71312]: INFO nova.compute.claims [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Claim successful on node user
Apr 14 05:59:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:59:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.247s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:59:09 user nova-compute[71312]: INFO nova.compute.claims [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Claim successful on node user
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:59:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:59:09 user nova-compute[71312]: INFO nova.virt.block_device [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Booting with volume 74dc3ebd-bb57-4a6a-be70-a383598ad5ff at /dev/vda
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.policy [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG os_brick.utils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bd6be9-fbee-4805-b0a1-c171f0f6cb4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b97015-d261-40f0-bcc1-c3e9395d1c1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f3e0d4-4968-4a25-9a03-2443ae927033]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddc67d9-89b2-42cd-b4f4-e750be108bbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 05:59:09 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ae0f2f-1743-465d-95dd-ed7d9fbb8e56]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG os_brick.utils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updating existing volume attachment record: 9a0fbcd2-db48-42cc-b6cd-59adcabda963 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:59:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.policy [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:59:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Creating image(s)
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "/opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "/opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "/opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Successfully created port: 6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkRpwKTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:59:10 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:59:10 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:59:10 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec2c55-3304-4cb6-b526-f77d29d62ec6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:59:10 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b08a909-9510-4e14-88fe-47b50f0b8ce8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190] added
Apr 14 05:59:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk 1073741824" returned: 0 in 0.057s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73cd328-8883-4cdc-9f33-43dbeb0b4145]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[770329c8-9cef-4fc7-8a53-66ba5862cde9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkRpwKTC {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkRpwKTC" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b31f45f-f115-4f82-8bbc-df1b0a316eac]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LkRpwKTC'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f8e0f5-b3db-4662-8e7d-b86ea6f79256]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c28a7e-1217-4a46-928d-21a5ebed937b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:10 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:10 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[636a1cba-4d04-4fb7-9fec-ee7c92e90dc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190, portal: 172.16.0.220,3260]
Apr 14 05:59:10 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190, portal: 172.16.0.220,3260] successful.
Apr 14 05:59:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1137d565-acab-4db5-9917-2ea35f2a334f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Cannot resize image /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'migration_context' on Instance uuid 909d40f9-ca97-4a34-bd3e-f9c98b27a963 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Ensure instance console log exists: /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Successfully created port: b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dfa599-29ca-43d2-853d-8394f59429f2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:10 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:10 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)
Apr 14 05:59:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:10 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:10 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)
Apr 14 05:59:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75a9050-8d7e-4c70-b1e2-fb6e9eb094e9]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451935.7891645, 8bc9e54a-dc25-421f-a380-a394b0867000 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:59:10 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] VM Stopped (Lifecycle Event)
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1612b032-d74c-46a2-b29d-816888fae727 None None] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Successfully updated port: 6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquired lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-changed-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Refreshing instance network info cache due to event network-changed-6a6b02b3-33b5-4330-9fa9-036ff4c19650. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] Acquiring lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updating instance_info_cache with network_info: [{"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Successfully updated port: b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Releasing lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Instance network_info: |[{"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquired lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] Acquired lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Refreshing network info cache for port 6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received event network-changed-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Refreshing instance network info cache due to event network-changed-b9ba85e5-aaf3-43c4-a3ed-241516556ced. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] Acquiring lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkRpwKTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23035366663316239', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035366663316239', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Updating instance_info_cache with network_info: [{"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'flavor' on Instance uuid 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Releasing lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Instance network_info: |[{"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] Acquired lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Refreshing network info cache for port b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Start _get_guest_xml network_info=[{"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:59:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:59:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-767513540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-767513540',id=27,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-rf6r6ia8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:59:10Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=909d40f9-ca97-4a34-bd3e-f9c98b27a963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:84:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9ba85e5-aaf3-43c4-a3ed-241516556ced,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ba85e5-aa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'pci_devices' on Instance uuid 909d40f9-ca97-4a34-bd3e-f9c98b27a963 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updated VIF entry in instance network info cache for port 6a6b02b3-33b5-4330-9fa9-036ff4c19650. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updating instance_info_cache with network_info: [{"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 05:59:11 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:59:11 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:59:11 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:59:11 user nova-compute[71312]:   <serial>759ab340-42b3-420f-b44c-c4dd4ec6e190</serial>
Apr 14 05:59:11 user nova-compute[71312]: </disk>
Apr 14 05:59:11 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:59:11 user nova-compute[71312]:   <uuid>909d40f9-ca97-4a34-bd3e-f9c98b27a963</uuid>
Apr 14 05:59:11 user nova-compute[71312]:   <name>instance-0000001b</name>
Apr 14 05:59:11 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:59:11 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:59:11 user nova-compute[71312]:   <metadata>
Apr 14 05:59:11 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:59:11 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:59:11 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-767513540</nova:name>
Apr 14 05:59:11 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:59:11</nova:creationTime>
Apr 14 05:59:11 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:59:11 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:59:11 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:59:11 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:59:11 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:59:11 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:59:11 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:59:11 user nova-compute[71312]:       <nova:owner>
Apr 14 05:59:11 user nova-compute[71312]:         <nova:user uuid="c4946885e01a4f0da206d796027b3c9f">tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member</nova:user>
Apr 14 05:59:11 user nova-compute[71312]:         <nova:project uuid="7034e2177823496a861a1601a5c06fe4">tempest-ServerBootFromVolumeStableRescueTest-315541711</nova:project>
Apr 14 05:59:11 user nova-compute[71312]:       </nova:owner>
Apr 14 05:59:11 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:59:11 user nova-compute[71312]:       <nova:ports>
Apr 14 05:59:11 user nova-compute[71312]:         <nova:port uuid="b9ba85e5-aaf3-43c4-a3ed-241516556ced">
Apr 14 05:59:11 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 05:59:11 user nova-compute[71312]:         </nova:port>
Apr 14 05:59:11 user nova-compute[71312]:       </nova:ports>
Apr 14 05:59:11 user nova-compute[71312]:     </nova:instance>
Apr 14 05:59:11 user nova-compute[71312]:   </metadata>
Apr 14 05:59:11 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:59:11 user nova-compute[71312]:     <system>
Apr 14 05:59:11 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:59:11 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:59:11 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:59:11 user nova-compute[71312]:       <entry name="serial">909d40f9-ca97-4a34-bd3e-f9c98b27a963</entry>
Apr 14 05:59:11 user nova-compute[71312]:       <entry name="uuid">909d40f9-ca97-4a34-bd3e-f9c98b27a963</entry>
Apr 14 05:59:11 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:59:11 user nova-compute[71312]:     </system>
Apr 14 05:59:11 user nova-compute[71312]:   </sysinfo>
Apr 14 05:59:11 user nova-compute[71312]:   <os>
Apr 14 05:59:11 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:59:11 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:59:11 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:59:11 user nova-compute[71312]:   </os>
Apr 14 05:59:11 user nova-compute[71312]:   <features>
Apr 14 05:59:11 user nova-compute[71312]:     <acpi/>
Apr 14 05:59:11 user nova-compute[71312]:     <apic/>
Apr 14 05:59:11 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:59:11 user nova-compute[71312]:   </features>
Apr 14 05:59:11 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:59:11 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:59:11 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:59:11 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:59:11 user nova-compute[71312]:   </clock>
Apr 14 05:59:11 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:59:11 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:59:11 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:59:11 user nova-compute[71312]:   </cpu>
Apr 14 05:59:11 user nova-compute[71312]:   <devices>
Apr 14 05:59:11 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:59:11 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:59:11 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk"/>
Apr 14 05:59:11 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:59:11 user nova-compute[71312]:     </disk>
Apr 14 05:59:11 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:59:11 user nova-compute[71312]:       <mac address="fa:16:3e:ca:84:c2"/>
Apr 14 05:59:11 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:59:11 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:59:11 user nova-compute[71312]:       <target dev="tapb9ba85e5-aa"/>
Apr 14 05:59:11 user nova-compute[71312]:     </interface>
Apr 14 05:59:11 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:59:11 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/console.log" append="off"/>
Apr 14 05:59:11 user nova-compute[71312]:     </serial>
Apr 14 05:59:11 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:59:11 user nova-compute[71312]:     <video>
Apr 14 05:59:11 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:59:11 user nova-compute[71312]:     </video>
Apr 14 05:59:11 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:59:11 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:59:11 user nova-compute[71312]:     </rng>
Apr 14 05:59:11 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:59:11 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:59:11 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:59:11 user nova-compute[71312]:     </memballoon>
Apr 14 05:59:11 user nova-compute[71312]:   </devices>
Apr 14 05:59:11 user nova-compute[71312]: </domain>
Apr 14 05:59:11 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-767513540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-767513540',id=27,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-rf6r6ia8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:59:10Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=909d40f9-ca97-4a34-bd3e-f9c98b27a963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:84:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9ba85e5-aaf3-43c4-a3ed-241516556ced,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ba85e5-aa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG os_vif [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:84:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9ba85e5-aaf3-43c4-a3ed-241516556ced,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ba85e5-aa') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9ba85e5-aa, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9ba85e5-aa, col_values=(('external_ids', {'iface-id': 'b9ba85e5-aaf3-43c4-a3ed-241516556ced', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:84:c2', 'vm-uuid': '909d40f9-ca97-4a34-bd3e-f9c98b27a963'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] Releasing lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:11 user nova-compute[71312]: INFO os_vif [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:84:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9ba85e5-aaf3-43c4-a3ed-241516556ced,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ba85e5-aa')
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:59:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No VIF found with MAC fa:16:3e:ca:84:c2, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:59:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Updated VIF entry in instance network info cache for port b9ba85e5-aaf3-43c4-a3ed-241516556ced. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:59:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Updating instance_info_cache with network_info: [{"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] Releasing lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:59:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:59:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No VIF found with MAC fa:16:3e:b6:87:8d, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:59:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.754s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received event network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] Acquiring lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] No waiting events found dispatching network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:13 user nova-compute[71312]: WARNING nova.compute.manager [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received unexpected event network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance with vm_state building and task_state spawning.
Apr 14 05:59:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:59:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:14 user nova-compute[71312]: INFO nova.compute.manager [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Detaching volume 759ab340-42b3-420f-b44c-c4dd4ec6e190
Apr 14 05:59:14 user nova-compute[71312]: INFO nova.virt.block_device [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Attempting to driver detach volume 759ab340-42b3-420f-b44c-c4dd4ec6e190 from mountpoint /dev/vdb
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:59:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Creating image(s)
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Ensure instance console log exists: /opt/stack/data/nova/instances/d8995825-7362-44ef-87b2-33c1f9f02e56/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Start _get_guest_xml network_info=[{"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '9a0fbcd2-db48-42cc-b6cd-59adcabda963', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJvcdqOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8995825-7362-44ef-87b2-33c1f9f02e56', 'attached_at': '', 'detached_at': '', 'volume_id': '74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'serial': '74dc3ebd-bb57-4a6a-be70-a383598ad5ff'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Attempting to detach device vdb from instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:59:14 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:59:14 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:59:14 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:59:14 user nova-compute[71312]:   <serial>759ab340-42b3-420f-b44c-c4dd4ec6e190</serial>
Apr 14 05:59:14 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:59:14 user nova-compute[71312]: </disk>
Apr 14 05:59:14 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Successfully detached device vdb from instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 from the persistent domain config.
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 05:59:14 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:59:14 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 05:59:14 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 05:59:14 user nova-compute[71312]:   <serial>759ab340-42b3-420f-b44c-c4dd4ec6e190</serial>
Apr 14 05:59:14 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 05:59:14 user nova-compute[71312]: </disk>
Apr 14 05:59:14 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 05:59:14 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:59:14 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJvcdqOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:59:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:59:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:59:14 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ab730-8670-45e9-b9c6-a9cf1961fc79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 05:59:14 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e6b5e8-4fc4-4207-9909-6c99b78c768c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff] added
Apr 14 05:59:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5651b8-1951-4e95-beda-6253a9d399f2]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad1e974-fc05-4bfb-a129-c1c54f2d0ca9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJvcdqOI {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJvcdqOI" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e62b62-43eb-4630-8a25-2bb72f3decc2]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MJvcdqOI'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50af59a-c668-468e-bb39-1bd8ceb06933]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd1f19-1307-45e9-8032-a2389cb99c8a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)
Apr 14 05:59:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)
Apr 14 05:59:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[943d7fe9-49f2-490a-bd05-97bc1bccb6d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260]
Apr 14 05:59:14 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260] successful.
Apr 14 05:59:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f49acf-5648-4a28-83f1-30a85d6f69ef]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b9507d-9eb8-493e-9f56-531f6f767a07]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:59:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)
Apr 14 05:59:14 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:59:14 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9ba550-58c1-4c91-a641-28ad57211316]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJvcdqOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681451954.9346015, 54eb0cb5-4998-4afe-9312-e7a3ea009d05 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 05:59:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Successfully detached device vdb from instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 from the live domain config.
Apr 14 05:59:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkRpwKTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 05:59:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 05:59:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451955.5676527, 909d40f9-ca97-4a34-bd3e-f9c98b27a963 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:59:15 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] VM Resumed (Lifecycle Event)
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:59:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Instance spawned successfully.
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:15 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451955.5704067, 909d40f9-ca97-4a34-bd3e-f9c98b27a963 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:59:15 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] VM Started (Lifecycle Event)
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received event network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] Acquiring lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] No waiting events found dispatching network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:15 user nova-compute[71312]: WARNING nova.compute.manager [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received unexpected event network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance with vm_state building and task_state spawning.
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 05:59:15 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:59:15 user nova-compute[71312]: INFO nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Took 5.83 seconds to spawn the instance on the hypervisor.
Apr 14 05:59:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.606s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== connect_volume: return (1608ms) {'type': 'block', 'scsi_wwn': '23764333164363637', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764333164363637', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.154s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 05:59:16 user nova-compute[71312]: INFO nova.compute.manager [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Took 7.18 seconds to build instance.
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:59:16 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8151MB free_disk=26.268699645996094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.267s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0841392-091f-45ee-9d9d-df1eb56a45aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 05:59:16 user nova-compute[71312]: No targets found.
Apr 14 05:59:16 user nova-compute[71312]: iSNS:
Apr 14 05:59:16 user nova-compute[71312]: No targets found.
Apr 14 05:59:16 user nova-compute[71312]: STATIC:
Apr 14 05:59:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 05:59:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:59:16 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:59:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190
Apr 14 05:59:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:59:16 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:59:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 05:59:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:59:16 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:59:16 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a
Apr 14 05:59:16 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 05:59:16 user nova-compute[71312]:                 Iface Name: default
Apr 14 05:59:16 user nova-compute[71312]: FIRMWARE:
Apr 14 05:59:16 user nova-compute[71312]: No targets found.
Apr 14 05:59:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 05:59:16 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 05:59:16 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2135968135',display_name='tempest-TestVolumeBootPattern-server-2135968135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2135968135',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-vlgsp2xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:59:09Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=d8995825-7362-44ef-87b2-33c1f9f02e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:fa:57,bridge_name='br-int',has_traffic_filtering=True,id=6a6b02b3-33b5-4330-9fa9-036ff4c19650,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b02b3-33') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'pci_devices' on Instance uuid d8995825-7362-44ef-87b2-33c1f9f02e56 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f12426-602b-4d68-ab18-e3062aa270dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:59:16 user nova-compute[71312]:   <uuid>d8995825-7362-44ef-87b2-33c1f9f02e56</uuid>
Apr 14 05:59:16 user nova-compute[71312]:   <name>instance-0000001a</name>
Apr 14 05:59:16 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:59:16 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:59:16 user nova-compute[71312]:   <metadata>
Apr 14 05:59:16 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:59:16 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:59:16 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-server-2135968135</nova:name>
Apr 14 05:59:16 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:59:14</nova:creationTime>
Apr 14 05:59:16 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:59:16 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:59:16 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:59:16 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:59:16 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:59:16 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:59:16 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:59:16 user nova-compute[71312]:       <nova:owner>
Apr 14 05:59:16 user nova-compute[71312]:         <nova:user uuid="670c42ab26ab49808773a20f14269e13">tempest-TestVolumeBootPattern-2132265128-project-member</nova:user>
Apr 14 05:59:16 user nova-compute[71312]:         <nova:project uuid="8134d4bfff8e465c8dc0a5342fee7e10">tempest-TestVolumeBootPattern-2132265128</nova:project>
Apr 14 05:59:16 user nova-compute[71312]:       </nova:owner>
Apr 14 05:59:16 user nova-compute[71312]:       <nova:ports>
Apr 14 05:59:16 user nova-compute[71312]:         <nova:port uuid="6a6b02b3-33b5-4330-9fa9-036ff4c19650">
Apr 14 05:59:16 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 05:59:16 user nova-compute[71312]:         </nova:port>
Apr 14 05:59:16 user nova-compute[71312]:       </nova:ports>
Apr 14 05:59:16 user nova-compute[71312]:     </nova:instance>
Apr 14 05:59:16 user nova-compute[71312]:   </metadata>
Apr 14 05:59:16 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:59:16 user nova-compute[71312]:     <system>
Apr 14 05:59:16 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:59:16 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:59:16 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:59:16 user nova-compute[71312]:       <entry name="serial">d8995825-7362-44ef-87b2-33c1f9f02e56</entry>
Apr 14 05:59:16 user nova-compute[71312]:       <entry name="uuid">d8995825-7362-44ef-87b2-33c1f9f02e56</entry>
Apr 14 05:59:16 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:59:16 user nova-compute[71312]:     </system>
Apr 14 05:59:16 user nova-compute[71312]:   </sysinfo>
Apr 14 05:59:16 user nova-compute[71312]:   <os>
Apr 14 05:59:16 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:59:16 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:59:16 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:59:16 user nova-compute[71312]:   </os>
Apr 14 05:59:16 user nova-compute[71312]:   <features>
Apr 14 05:59:16 user nova-compute[71312]:     <acpi/>
Apr 14 05:59:16 user nova-compute[71312]:     <apic/>
Apr 14 05:59:16 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:59:16 user nova-compute[71312]:   </features>
Apr 14 05:59:16 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:59:16 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:59:16 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:59:16 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:59:16 user nova-compute[71312]:   </clock>
Apr 14 05:59:16 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:59:16 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:59:16 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:59:16 user nova-compute[71312]:   </cpu>
Apr 14 05:59:16 user nova-compute[71312]:   <devices>
Apr 14 05:59:16 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 05:59:16 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 05:59:16 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Apr 14 05:59:16 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:59:16 user nova-compute[71312]:       <serial>74dc3ebd-bb57-4a6a-be70-a383598ad5ff</serial>
Apr 14 05:59:16 user nova-compute[71312]:     </disk>
Apr 14 05:59:16 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:59:16 user nova-compute[71312]:       <mac address="fa:16:3e:46:fa:57"/>
Apr 14 05:59:16 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:59:16 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:59:16 user nova-compute[71312]:       <target dev="tap6a6b02b3-33"/>
Apr 14 05:59:16 user nova-compute[71312]:     </interface>
Apr 14 05:59:16 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:59:16 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/d8995825-7362-44ef-87b2-33c1f9f02e56/console.log" append="off"/>
Apr 14 05:59:16 user nova-compute[71312]:     </serial>
Apr 14 05:59:16 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:59:16 user nova-compute[71312]:     <video>
Apr 14 05:59:16 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:59:16 user nova-compute[71312]:     </video>
Apr 14 05:59:16 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:59:16 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:59:16 user nova-compute[71312]:     </rng>
Apr 14 05:59:16 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:59:16 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:59:16 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:59:16 user nova-compute[71312]:     </memballoon>
Apr 14 05:59:16 user nova-compute[71312]:   </devices>
Apr 14 05:59:16 user nova-compute[71312]: </domain>
Apr 14 05:59:16 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2135968135',display_name='tempest-TestVolumeBootPattern-server-2135968135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2135968135',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-vlgsp2xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:59:09Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=d8995825-7362-44ef-87b2-33c1f9f02e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:fa:57,bridge_name='br-int',has_traffic_filtering=True,id=6a6b02b3-33b5-4330-9fa9-036ff4c19650,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b02b3-33') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_vif [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:fa:57,bridge_name='br-int',has_traffic_filtering=True,id=6a6b02b3-33b5-4330-9fa9-036ff4c19650,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b02b3-33') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a6b02b3-33, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a6b02b3-33, col_values=(('external_ids', {'iface-id': '6a6b02b3-33b5-4330-9fa9-036ff4c19650', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:fa:57', 'vm-uuid': 'd8995825-7362-44ef-87b2-33c1f9f02e56'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:16 user nova-compute[71312]: INFO os_vif [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:fa:57,bridge_name='br-int',has_traffic_filtering=True,id=6a6b02b3-33b5-4330-9fa9-036ff4c19650,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b02b3-33')
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[34710c99-714b-438d-a70d-80e35085174d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:16 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:16 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)
Apr 14 05:59:16 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:59:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 05:59:16 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 05:59:16 user nova-compute[71312]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 (non-flash)
Apr 14 05:59:16 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 05:59:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c41fb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[903cd3e2-a81d-4bce-b7e9-916940b72991]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No VIF found with MAC fa:16:3e:46:fa:57, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 88eea6fd-6dde-4692-891e-0587ae62d90c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance d8995825-7362-44ef-87b2-33c1f9f02e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd72e32-74fe-4448-9b47-4ce8f22b0cbb]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8cf247-161f-4078-ace6-33e4409eef6d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[79110eea-be7c-4969-ae87-c675fef98caa]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3e9667-ca2a-46c4-975e-776f225bab6a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[92abb116-d4f2-4ca4-bc3d-32f512b2b762]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190, portal: 172.16.0.220,3260]
Apr 14 05:59:16 user nova-compute[71312]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190, portal: 172.16.0.220,3260] successful.
Apr 14 05:59:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759ab340-42b3-420f-b44c-c4dd4ec6e190 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8c140f-82ed-419b-aa59-f8daf288448f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] <== disconnect_volume: return (1495ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 05:59:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'flavor' on Instance uuid 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.977s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] Acquiring lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] No waiting events found dispatching network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:17 user nova-compute[71312]: WARNING nova.compute.manager [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received unexpected event network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance with vm_state building and task_state spawning.
Apr 14 05:59:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451959.6660948, d8995825-7362-44ef-87b2-33c1f9f02e56 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:59:19 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] VM Resumed (Lifecycle Event)
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:59:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Instance spawned successfully.
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 05:59:19 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451959.6676815, d8995825-7362-44ef-87b2-33c1f9f02e56 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:59:19 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] VM Started (Lifecycle Event)
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:59:19 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:59:19 user nova-compute[71312]: INFO nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Took 5.43 seconds to spawn the instance on the hypervisor.
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] Acquiring lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] No waiting events found dispatching network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:19 user nova-compute[71312]: WARNING nova.compute.manager [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received unexpected event network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance with vm_state building and task_state spawning.
Apr 14 05:59:19 user nova-compute[71312]: INFO nova.compute.manager [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Took 11.09 seconds to build instance.
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.191s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Updating instance_info_cache with network_info: [{"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-88eea6fd-6dde-4692-891e-0587ae62d90c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-changed-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Refreshing instance network info cache due to event network-changed-164b82d4-a91d-462e-9018-d6ef229e6aec. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] Acquiring lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] Acquired lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Refreshing network info cache for port 164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:59:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updated VIF entry in instance network info cache for port 164b82d4-a91d-462e-9018-d6ef229e6aec. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:59:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating instance_info_cache with network_info: [{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] Releasing lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:24 user nova-compute[71312]: INFO nova.compute.manager [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Shelving
Apr 14 05:59:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:25 user nova-compute[71312]: WARNING nova.compute.manager [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state active and task_state shelving.
Apr 14 05:59:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance destroyed successfully.
Apr 14 05:59:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Beginning cold snapshot process
Apr 14 05:59:25 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 05:59:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk /opt/stack/data/nova/instances/snapshots/tmp02esbukx/7aa625aa5e19441fb662d289b3dc5e18 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk /opt/stack/data/nova/instances/snapshots/tmp02esbukx/7aa625aa5e19441fb662d289b3dc5e18" returned: 0 in 0.446s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Snapshot extracted, beginning image upload
Apr 14 05:59:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:27 user nova-compute[71312]: WARNING nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:27 user nova-compute[71312]: WARNING nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:27 user nova-compute[71312]: WARNING nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:27 user nova-compute[71312]: WARNING nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:27 user nova-compute[71312]: WARNING nova.compute.manager [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 05:59:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Snapshot image upload complete
Apr 14 05:59:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:28 user nova-compute[71312]: INFO nova.compute.manager [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Shelve offloading
Apr 14 05:59:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance destroyed successfully.
Apr 14 05:59:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquired lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating instance_info_cache with network_info: [{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Releasing lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance destroyed successfully.
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'resources' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1479627857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1479627857',id=25,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj45WaFx8qIhjQPabhfxsWHA1PKIKKwtfrQJR3MqBpiqoCGN6x1pQ48FY1HRxszOWvQ149S+9eT9WsV7wUAXKXME2zAw5wX99IzrhcOJC2qmHxSZPdB5oJ1T5winHfSMw==',key_name='tempest-keypair-281561404',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-0fh0slm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member',shelved_at='2023-04-14T05:59:28.487405',shelved_host='user',shelved_image_id='a362e793-faa0-42d7-99d9-76c1dbdc1961'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=b7f31928-32b3-4d1e-bb7c-7b4799ce6439,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG os_vif [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap164b82d4-a9, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-changed-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Refreshing instance network info cache due to event network-changed-164b82d4-a91d-462e-9018-d6ef229e6aec. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] Acquiring lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] Acquired lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.network.neutron [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Refreshing network info cache for port 164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:59:29 user nova-compute[71312]: INFO os_vif [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9')
Apr 14 05:59:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Deleting instance files /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439_del
Apr 14 05:59:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Deletion of /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439_del complete
Apr 14 05:59:29 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Deleted allocations for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439
Apr 14 05:59:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'numa_topology' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:30 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:59:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updated VIF entry in instance network info cache for port 164b82d4-a91d-462e-9018-d6ef229e6aec. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:59:30 user nova-compute[71312]: DEBUG nova.network.neutron [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating instance_info_cache with network_info: [{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap164b82d4-a9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:30 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:59:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] Releasing lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.695s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:40 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681451965.446613, b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:59:40 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] VM Stopped (Lifecycle Event)
Apr 14 05:59:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-60e2bb72-e066-487d-8700-e51c579140ec None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 05:59:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:48 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 05:59:48 user nova-compute[71312]: INFO nova.compute.claims [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Claim successful on node user
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 05:59:49 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.policy [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 05:59:49 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Creating image(s)
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "/opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "/opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "/opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.126s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk 1073741824" returned: 0 in 0.047s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Cannot resize image /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.objects.instance [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'migration_context' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Ensure instance console log exists: /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Successfully created port: 907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Successfully updated port: 907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquired lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-changed-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Refreshing instance network info cache due to event network-changed-907e4f56-85d9-4e2b-a241-f5fe7eded6fb. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] Acquiring lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Updating instance_info_cache with network_info: [{"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Releasing lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Instance network_info: |[{"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] Acquired lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Refreshing network info cache for port 907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Start _get_guest_xml network_info=[{"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 05:59:51 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:59:51 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-683982699',display_name='tempest-AttachVolumeTestJSON-server-683982699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-683982699',id=28,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjST9Vq/RQ6pRTDrm1LbOsfcNfa1pbuGiC/r0eq7E3wVhoIdnwjwbWoGndyV/U8/jakU32Rad8q17apaLNEIBegaTidnfQE6Kt2hnJWaPy6aVHSpoc9Zhtwr72fSCPj9w==',key_name='tempest-keypair-597319774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-0awcm7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=f06b97a7-d8e3-46e4-9e4d-3566f52ee22c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:92,bridge_name='br-int',has_traffic_filtering=True,id=907e4f56-85d9-4e2b-a241-f5fe7eded6fb,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907e4f56-85') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.objects.instance [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'pci_devices' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 05:59:51 user nova-compute[71312]:   <uuid>f06b97a7-d8e3-46e4-9e4d-3566f52ee22c</uuid>
Apr 14 05:59:51 user nova-compute[71312]:   <name>instance-0000001c</name>
Apr 14 05:59:51 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 05:59:51 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 05:59:51 user nova-compute[71312]:   <metadata>
Apr 14 05:59:51 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 05:59:51 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 05:59:51 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeTestJSON-server-683982699</nova:name>
Apr 14 05:59:51 user nova-compute[71312]:       <nova:creationTime>2023-04-14 05:59:51</nova:creationTime>
Apr 14 05:59:51 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 05:59:51 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 05:59:51 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 05:59:51 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 05:59:51 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 05:59:51 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 05:59:51 user nova-compute[71312]:       </nova:flavor>
Apr 14 05:59:51 user nova-compute[71312]:       <nova:owner>
Apr 14 05:59:51 user nova-compute[71312]:         <nova:user uuid="3aa9911d299b409f9ccc8a55e7b3ec5b">tempest-AttachVolumeTestJSON-1872023683-project-member</nova:user>
Apr 14 05:59:51 user nova-compute[71312]:         <nova:project uuid="5c0f5758b623402393ec9eb273c7ae6f">tempest-AttachVolumeTestJSON-1872023683</nova:project>
Apr 14 05:59:51 user nova-compute[71312]:       </nova:owner>
Apr 14 05:59:51 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 05:59:51 user nova-compute[71312]:       <nova:ports>
Apr 14 05:59:51 user nova-compute[71312]:         <nova:port uuid="907e4f56-85d9-4e2b-a241-f5fe7eded6fb">
Apr 14 05:59:51 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 05:59:51 user nova-compute[71312]:         </nova:port>
Apr 14 05:59:51 user nova-compute[71312]:       </nova:ports>
Apr 14 05:59:51 user nova-compute[71312]:     </nova:instance>
Apr 14 05:59:51 user nova-compute[71312]:   </metadata>
Apr 14 05:59:51 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 05:59:51 user nova-compute[71312]:     <system>
Apr 14 05:59:51 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 05:59:51 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 05:59:51 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 05:59:51 user nova-compute[71312]:       <entry name="serial">f06b97a7-d8e3-46e4-9e4d-3566f52ee22c</entry>
Apr 14 05:59:51 user nova-compute[71312]:       <entry name="uuid">f06b97a7-d8e3-46e4-9e4d-3566f52ee22c</entry>
Apr 14 05:59:51 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 05:59:51 user nova-compute[71312]:     </system>
Apr 14 05:59:51 user nova-compute[71312]:   </sysinfo>
Apr 14 05:59:51 user nova-compute[71312]:   <os>
Apr 14 05:59:51 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 05:59:51 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 05:59:51 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 05:59:51 user nova-compute[71312]:   </os>
Apr 14 05:59:51 user nova-compute[71312]:   <features>
Apr 14 05:59:51 user nova-compute[71312]:     <acpi/>
Apr 14 05:59:51 user nova-compute[71312]:     <apic/>
Apr 14 05:59:51 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 05:59:51 user nova-compute[71312]:   </features>
Apr 14 05:59:51 user nova-compute[71312]:   <clock offset="utc">
Apr 14 05:59:51 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 05:59:51 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 05:59:51 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 05:59:51 user nova-compute[71312]:   </clock>
Apr 14 05:59:51 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 05:59:51 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 05:59:51 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 05:59:51 user nova-compute[71312]:   </cpu>
Apr 14 05:59:51 user nova-compute[71312]:   <devices>
Apr 14 05:59:51 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 05:59:51 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 05:59:51 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk"/>
Apr 14 05:59:51 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 05:59:51 user nova-compute[71312]:     </disk>
Apr 14 05:59:51 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 05:59:51 user nova-compute[71312]:       <mac address="fa:16:3e:ad:4f:92"/>
Apr 14 05:59:51 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:59:51 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 05:59:51 user nova-compute[71312]:       <target dev="tap907e4f56-85"/>
Apr 14 05:59:51 user nova-compute[71312]:     </interface>
Apr 14 05:59:51 user nova-compute[71312]:     <serial type="pty">
Apr 14 05:59:51 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/console.log" append="off"/>
Apr 14 05:59:51 user nova-compute[71312]:     </serial>
Apr 14 05:59:51 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 05:59:51 user nova-compute[71312]:     <video>
Apr 14 05:59:51 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 05:59:51 user nova-compute[71312]:     </video>
Apr 14 05:59:51 user nova-compute[71312]:     <rng model="virtio">
Apr 14 05:59:51 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 05:59:51 user nova-compute[71312]:     </rng>
Apr 14 05:59:51 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 05:59:51 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 05:59:51 user nova-compute[71312]:       <stats period="10"/>
Apr 14 05:59:51 user nova-compute[71312]:     </memballoon>
Apr 14 05:59:51 user nova-compute[71312]:   </devices>
Apr 14 05:59:51 user nova-compute[71312]: </domain>
Apr 14 05:59:51 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-683982699',display_name='tempest-AttachVolumeTestJSON-server-683982699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-683982699',id=28,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjST9Vq/RQ6pRTDrm1LbOsfcNfa1pbuGiC/r0eq7E3wVhoIdnwjwbWoGndyV/U8/jakU32Rad8q17apaLNEIBegaTidnfQE6Kt2hnJWaPy6aVHSpoc9Zhtwr72fSCPj9w==',key_name='tempest-keypair-597319774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-0awcm7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T05:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=f06b97a7-d8e3-46e4-9e4d-3566f52ee22c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:92,bridge_name='br-int',has_traffic_filtering=True,id=907e4f56-85d9-4e2b-a241-f5fe7eded6fb,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907e4f56-85') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG os_vif [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:92,bridge_name='br-int',has_traffic_filtering=True,id=907e4f56-85d9-4e2b-a241-f5fe7eded6fb,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907e4f56-85') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap907e4f56-85, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap907e4f56-85, col_values=(('external_ids', {'iface-id': '907e4f56-85d9-4e2b-a241-f5fe7eded6fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:4f:92', 'vm-uuid': 'f06b97a7-d8e3-46e4-9e4d-3566f52ee22c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:51 user nova-compute[71312]: INFO os_vif [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:92,bridge_name='br-int',has_traffic_filtering=True,id=907e4f56-85d9-4e2b-a241-f5fe7eded6fb,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907e4f56-85')
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No VIF found with MAC fa:16:3e:ad:4f:92, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Updated VIF entry in instance network info cache for port 907e4f56-85d9-4e2b-a241-f5fe7eded6fb. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Updating instance_info_cache with network_info: [{"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 05:59:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] Releasing lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 05:59:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] No waiting events found dispatching network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:53 user nova-compute[71312]: WARNING nova.compute.manager [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received unexpected event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance with vm_state building and task_state spawning.
Apr 14 05:59:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451995.0576837, f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:59:55 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] VM Resumed (Lifecycle Event)
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 05:59:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Instance spawned successfully.
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 05:59:55 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681451995.059167, f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 05:59:55 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] VM Started (Lifecycle Event)
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 05:59:55 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 05:59:55 user nova-compute[71312]: INFO nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Took 5.84 seconds to spawn the instance on the hypervisor.
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] No waiting events found dispatching network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 05:59:55 user nova-compute[71312]: WARNING nova.compute.manager [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received unexpected event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance with vm_state building and task_state spawning.
Apr 14 05:59:55 user nova-compute[71312]: INFO nova.compute.manager [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Took 6.52 seconds to build instance.
Apr 14 05:59:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.627s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 05:59:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 05:59:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "88eea6fd-6dde-4692-891e-0587ae62d90c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:03 user nova-compute[71312]: INFO nova.compute.manager [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Terminating instance
Apr 14 06:00:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received event network-vif-unplugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] Acquiring lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] No waiting events found dispatching network-vif-unplugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received event network-vif-unplugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:00:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Instance destroyed successfully.
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lazy-loading 'resources' on Instance uuid 88eea6fd-6dde-4692-891e-0587ae62d90c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1248527205',display_name='tempest-ServersNegativeTestJSON-server-1248527205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1248527205',id=17,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='289cfed4776048b18eca85457a194bfb',ramdisk_id='',reservation_id='r-0lrt044b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1687375833',owner_user_name='tempest-ServersNegativeTestJSON-1687375833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:51:27Z,user_data=None,user_id='4e56c03cd09f4a3882e8dffbbaa40c97',uuid=88eea6fd-6dde-4692-891e-0587ae62d90c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converting VIF {"id": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "address": "fa:16:3e:75:8d:d2", "network": {"id": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-233772422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "289cfed4776048b18eca85457a194bfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ab07a22-05", "ovs_interfaceid": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:8d:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab07a22-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG os_vif [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:8d:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab07a22-05') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ab07a22-05, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:00:04 user nova-compute[71312]: INFO os_vif [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:8d:d2,bridge_name='br-int',has_traffic_filtering=True,id=0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8,network=Network(0af82dbe-8b33-44ba-9d0a-3653b2dcc439),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ab07a22-05')
Apr 14 06:00:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Deleting instance files /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c_del
Apr 14 06:00:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Deletion of /opt/stack/data/nova/instances/88eea6fd-6dde-4692-891e-0587ae62d90c_del complete
Apr 14 06:00:04 user nova-compute[71312]: INFO nova.compute.manager [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 06:00:04 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:00:04 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:00:05 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:00:05 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Took 0.54 seconds to deallocate network for instance.
Apr 14 06:00:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:00:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:00:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:05 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Deleted allocations for instance 88eea6fd-6dde-4692-891e-0587ae62d90c
Apr 14 06:00:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received event network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:00:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Acquiring lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Lock "88eea6fd-6dde-4692-891e-0587ae62d90c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] No waiting events found dispatching network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:00:06 user nova-compute[71312]: WARNING nova.compute.manager [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received unexpected event network-vif-plugged-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance with vm_state deleted and task_state None.
Apr 14 06:00:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Received event network-vif-deleted-0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:00:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:00:08 user nova-compute[71312]: INFO nova.compute.manager [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] instance snapshotting
Apr 14 06:00:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Beginning live snapshot process
Apr 14 06:00:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:08 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp24wkoq03/35cc16a0f8aa462da0047af15acc9e9e.delta 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp24wkoq03/35cc16a0f8aa462da0047af15acc9e9e.delta 1073741824" returned: 0 in 0.047s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 06:00:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 06:00:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 06:00:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 06:00:10 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 06:00:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp24wkoq03/35cc16a0f8aa462da0047af15acc9e9e.delta /opt/stack/data/nova/instances/snapshots/tmp24wkoq03/35cc16a0f8aa462da0047af15acc9e9e {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp24wkoq03/35cc16a0f8aa462da0047af15acc9e9e.delta /opt/stack/data/nova/instances/snapshots/tmp24wkoq03/35cc16a0f8aa462da0047af15acc9e9e" returned: 0 in 0.349s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Snapshot extracted, beginning image upload
Apr 14 06:00:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:11 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:00:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:00:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Snapshot image upload complete
Apr 14 06:00:13 user nova-compute[71312]: INFO nova.compute.manager [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Took 4.47 seconds to snapshot the instance on the hypervisor.
Apr 14 06:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:00:13 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:00:13 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=26.192462921142578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance d8995825-7362-44ef-87b2-33c1f9f02e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:00:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:00:14 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:00:14 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:00:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:00:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:00:18 user nova-compute[71312]: INFO nova.compute.claims [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Claim successful on node user
Apr 14 06:00:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:00:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:00:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.policy [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:00:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Creating image(s)
Apr 14 06:00:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "/opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "/opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "4d15f8c008b84b1efc031e2b71c858d4d5d3ddab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "4d15f8c008b84b1efc031e2b71c858d4d5d3ddab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452004.7685008, 88eea6fd-6dde-4692-891e-0587ae62d90c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:00:19 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] VM Stopped (Lifecycle Event)
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Successfully created port: 3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6e5e28b4-d683-4710-a575-1a51776791f9 None None] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab.part --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.virt.images [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 4cbeb851-7902-440c-b088-480ecfc4ac6a was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 06:00:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab.part /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab.part /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab.converted" returned: 0 in 0.209s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "4d15f8c008b84b1efc031e2b71c858d4d5d3ddab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.132s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "4d15f8c008b84b1efc031e2b71c858d4d5d3ddab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "4d15f8c008b84b1efc031e2b71c858d4d5d3ddab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Successfully updated port: 3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquired lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received event network-changed-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Refreshing instance network info cache due to event network-changed-3250a79a-10f7-4b4f-bd5c-a70104f878dd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] Acquiring lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab,backing_fmt=raw /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab,backing_fmt=raw /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk 1073741824" returned: 0 in 0.048s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "4d15f8c008b84b1efc031e2b71c858d4d5d3ddab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'migration_context' on Instance uuid 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Ensure instance console log exists: /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updating instance_info_cache with network_info: [{"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Releasing lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Instance network_info: |[{"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] Acquired lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Refreshing network info cache for port 3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Start _get_guest_xml network_info=[{"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4394af8502791fab92094810b4006168',container_format='bare',created_at=2023-04-14T06:00:08Z,direct_url=<?>,disk_format='qcow2',id=4cbeb851-7902-440c-b088-480ecfc4ac6a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2105900536',owner='ad1d1e07cab842139c5a42a9f98a0de3',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T06:00:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '4cbeb851-7902-440c-b088-480ecfc4ac6a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:00:20 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:00:20 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4394af8502791fab92094810b4006168',container_format='bare',created_at=2023-04-14T06:00:08Z,direct_url=<?>,disk_format='qcow2',id=4cbeb851-7902-440c-b088-480ecfc4ac6a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2105900536',owner='ad1d1e07cab842139c5a42a9f98a0de3',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T06:00:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:00:20 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-78804805',display_name='tempest-TestStampPattern-server-78804805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-78804805',id=29,image_ref='4cbeb851-7902-440c-b088-480ecfc4ac6a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcG2b0c5lB1OTtRptiZOYLsv66c2YAO6Emth1PUn8sXGE4GHBGxeL8wBPcM1Lm0S0rTUfPzymAH0yKo7CcszDhOuQKdNtWzOBHBlEzaLALbxv6+KJBJZLkYLwUsiabyhg==',key_name='tempest-TestStampPattern-1286641636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad1d1e07cab842139c5a42a9f98a0de3',ramdisk_id='',reservation_id='r-mfhamcla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='54eb0cb5-4998-4afe-9312-e7a3ea009d05',image_min_disk='1',image_min_ram='0',image_owner_id='ad1d1e07cab842139c5a42a9f98a0de3',image_owner_project_name='tempest-TestStampPattern-43185348',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-43185348-project-member',image_user_id='80e1861ede2547f1b3051829eaef8b7b',network_allocated='True',owner_project_name='tempest-TestStampPattern-43185348',owner_user_name='tempest-TestStampPattern-43185348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:00:19Z,user_data=None,user_id='80e1861ede2547f1b3051829eaef8b7b',uuid=3f1c0a57-5272-4d8e-a1d7-204c843a1a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converting VIF {"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=3250a79a-10f7-4b4f-bd5c-a70104f878dd,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3250a79a-10') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:00:21 user nova-compute[71312]:   <uuid>3f1c0a57-5272-4d8e-a1d7-204c843a1a22</uuid>
Apr 14 06:00:21 user nova-compute[71312]:   <name>instance-0000001d</name>
Apr 14 06:00:21 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:00:21 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:00:21 user nova-compute[71312]:   <metadata>
Apr 14 06:00:21 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:00:21 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:00:21 user nova-compute[71312]:       <nova:name>tempest-TestStampPattern-server-78804805</nova:name>
Apr 14 06:00:21 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:00:20</nova:creationTime>
Apr 14 06:00:21 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:00:21 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:00:21 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:00:21 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:00:21 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:00:21 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:00:21 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:00:21 user nova-compute[71312]:       <nova:owner>
Apr 14 06:00:21 user nova-compute[71312]:         <nova:user uuid="80e1861ede2547f1b3051829eaef8b7b">tempest-TestStampPattern-43185348-project-member</nova:user>
Apr 14 06:00:21 user nova-compute[71312]:         <nova:project uuid="ad1d1e07cab842139c5a42a9f98a0de3">tempest-TestStampPattern-43185348</nova:project>
Apr 14 06:00:21 user nova-compute[71312]:       </nova:owner>
Apr 14 06:00:21 user nova-compute[71312]:       <nova:root type="image" uuid="4cbeb851-7902-440c-b088-480ecfc4ac6a"/>
Apr 14 06:00:21 user nova-compute[71312]:       <nova:ports>
Apr 14 06:00:21 user nova-compute[71312]:         <nova:port uuid="3250a79a-10f7-4b4f-bd5c-a70104f878dd">
Apr 14 06:00:21 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 06:00:21 user nova-compute[71312]:         </nova:port>
Apr 14 06:00:21 user nova-compute[71312]:       </nova:ports>
Apr 14 06:00:21 user nova-compute[71312]:     </nova:instance>
Apr 14 06:00:21 user nova-compute[71312]:   </metadata>
Apr 14 06:00:21 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:00:21 user nova-compute[71312]:     <system>
Apr 14 06:00:21 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:00:21 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:00:21 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:00:21 user nova-compute[71312]:       <entry name="serial">3f1c0a57-5272-4d8e-a1d7-204c843a1a22</entry>
Apr 14 06:00:21 user nova-compute[71312]:       <entry name="uuid">3f1c0a57-5272-4d8e-a1d7-204c843a1a22</entry>
Apr 14 06:00:21 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:00:21 user nova-compute[71312]:     </system>
Apr 14 06:00:21 user nova-compute[71312]:   </sysinfo>
Apr 14 06:00:21 user nova-compute[71312]:   <os>
Apr 14 06:00:21 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:00:21 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:00:21 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:00:21 user nova-compute[71312]:   </os>
Apr 14 06:00:21 user nova-compute[71312]:   <features>
Apr 14 06:00:21 user nova-compute[71312]:     <acpi/>
Apr 14 06:00:21 user nova-compute[71312]:     <apic/>
Apr 14 06:00:21 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:00:21 user nova-compute[71312]:   </features>
Apr 14 06:00:21 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:00:21 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:00:21 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:00:21 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:00:21 user nova-compute[71312]:   </clock>
Apr 14 06:00:21 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:00:21 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:00:21 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:00:21 user nova-compute[71312]:   </cpu>
Apr 14 06:00:21 user nova-compute[71312]:   <devices>
Apr 14 06:00:21 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:00:21 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:00:21 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk"/>
Apr 14 06:00:21 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:00:21 user nova-compute[71312]:     </disk>
Apr 14 06:00:21 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:00:21 user nova-compute[71312]:       <mac address="fa:16:3e:53:7d:ed"/>
Apr 14 06:00:21 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:00:21 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:00:21 user nova-compute[71312]:       <target dev="tap3250a79a-10"/>
Apr 14 06:00:21 user nova-compute[71312]:     </interface>
Apr 14 06:00:21 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:00:21 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/console.log" append="off"/>
Apr 14 06:00:21 user nova-compute[71312]:     </serial>
Apr 14 06:00:21 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:00:21 user nova-compute[71312]:     <video>
Apr 14 06:00:21 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:00:21 user nova-compute[71312]:     </video>
Apr 14 06:00:21 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:00:21 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:00:21 user nova-compute[71312]:     </rng>
Apr 14 06:00:21 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:00:21 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:00:21 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:00:21 user nova-compute[71312]:     </memballoon>
Apr 14 06:00:21 user nova-compute[71312]:   </devices>
Apr 14 06:00:21 user nova-compute[71312]: </domain>
Apr 14 06:00:21 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-78804805',display_name='tempest-TestStampPattern-server-78804805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-78804805',id=29,image_ref='4cbeb851-7902-440c-b088-480ecfc4ac6a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcG2b0c5lB1OTtRptiZOYLsv66c2YAO6Emth1PUn8sXGE4GHBGxeL8wBPcM1Lm0S0rTUfPzymAH0yKo7CcszDhOuQKdNtWzOBHBlEzaLALbxv6+KJBJZLkYLwUsiabyhg==',key_name='tempest-TestStampPattern-1286641636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad1d1e07cab842139c5a42a9f98a0de3',ramdisk_id='',reservation_id='r-mfhamcla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='54eb0cb5-4998-4afe-9312-e7a3ea009d05',image_min_disk='1',image_min_ram='0',image_owner_id='ad1d1e07cab842139c5a42a9f98a0de3',image_owner_project_name='tempest-TestStampPattern-43185348',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-43185348-project-member',image_user_id='80e1861ede2547f1b3051829eaef8b7b',network_allocated='True',owner_project_name='tempest-TestStampPattern-43185348',owner_user_name='tempest-TestStampPattern-43185348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:00:19Z,user_data=None,user_id='80e1861ede2547f1b3051829eaef8b7b',uuid=3f1c0a57-5272-4d8e-a1d7-204c843a1a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converting VIF {"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=3250a79a-10f7-4b4f-bd5c-a70104f878dd,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3250a79a-10') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG os_vif [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=3250a79a-10f7-4b4f-bd5c-a70104f878dd,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3250a79a-10') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3250a79a-10, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3250a79a-10, col_values=(('external_ids', {'iface-id': '3250a79a-10f7-4b4f-bd5c-a70104f878dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:7d:ed', 'vm-uuid': '3f1c0a57-5272-4d8e-a1d7-204c843a1a22'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:21 user nova-compute[71312]: INFO os_vif [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=3250a79a-10f7-4b4f-bd5c-a70104f878dd,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3250a79a-10')
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No VIF found with MAC fa:16:3e:53:7d:ed, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updated VIF entry in instance network info cache for port 3250a79a-10f7-4b4f-bd5c-a70104f878dd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updating instance_info_cache with network_info: [{"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] Releasing lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:00:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating instance_info_cache with network_info: [{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received event network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] No waiting events found dispatching network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:00:22 user nova-compute[71312]: WARNING nova.compute.manager [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received unexpected event network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance with vm_state building and task_state spawning.
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452024.3898544, 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:00:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] VM Resumed (Lifecycle Event)
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:00:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Instance spawned successfully.
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:00:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452024.3913045, 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:00:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] VM Started (Lifecycle Event)
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:00:24 user nova-compute[71312]: INFO nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:00:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:00:24 user nova-compute[71312]: INFO nova.compute.manager [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Took 6.00 seconds to build instance.
Apr 14 06:00:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.093s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received event network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] No waiting events found dispatching network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:00:24 user nova-compute[71312]: WARNING nova.compute.manager [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received unexpected event network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance with vm_state active and task_state None.
Apr 14 06:00:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:00:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:00:25 user nova-compute[71312]: INFO nova.compute.manager [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Detaching volume c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a
Apr 14 06:00:25 user nova-compute[71312]: INFO nova.virt.block_device [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attempting to driver detach volume c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a from mountpoint /dev/vdb
Apr 14 06:00:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Attempting to detach device vdb from instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:00:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:00:25 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:00:25 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:00:25 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:00:25 user nova-compute[71312]:   <serial>c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a</serial>
Apr 14 06:00:25 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 06:00:25 user nova-compute[71312]: </disk>
Apr 14 06:00:25 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:00:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully detached device vdb from instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 from the persistent domain config.
Apr 14 06:00:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:00:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:00:25 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:00:25 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:00:25 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:00:25 user nova-compute[71312]:   <serial>c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a</serial>
Apr 14 06:00:25 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 06:00:25 user nova-compute[71312]: </disk>
Apr 14 06:00:25 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452026.1870964, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:00:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully detached device vdb from instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 from the live domain config.
Apr 14 06:00:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnDXwzQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:00:26 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[44482bbc-965e-4eb1-94e7-616522d61d3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:00:26 user nova-compute[71312]: No targets found.
Apr 14 06:00:26 user nova-compute[71312]: iSNS:
Apr 14 06:00:26 user nova-compute[71312]: No targets found.
Apr 14 06:00:26 user nova-compute[71312]: STATIC:
Apr 14 06:00:26 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 06:00:26 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:00:26 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:00:26 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:00:26 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:00:26 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:00:26 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a
Apr 14 06:00:26 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:00:26 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:00:26 user nova-compute[71312]: FIRMWARE:
Apr 14 06:00:26 user nova-compute[71312]: No targets found.
Apr 14 06:00:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:00:26 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:00:26 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55acd97-a0fa-4fe9-9118-58896d3a79c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ff376-8e89-4841-bef4-2d30cf80462a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:00:26 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 06:00:26 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:00:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:00:26 user nova-compute[71312]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a (non-flash)
Apr 14 06:00:26 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:00:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc210a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b310f3-a373-4878-adfa-ce09660ae83f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5b93af-885f-4456-ae0c-16feb14a1054]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0662f0d3-b7a8-4a35-b838-174990e7b020]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea2d4d6-785d-4de4-8fc6-7d5f8460a24f]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bca0f30-8bee-475e-8bb7-f390ec4d12e5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[104f65b7-fd6d-495b-833c-c3d22daba17d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260]
Apr 14 06:00:26 user nova-compute[71312]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a, portal: 172.16.0.220,3260] successful.
Apr 14 06:00:26 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3771715-ae23-4a20-acb0-e6a982d099b9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== disconnect_volume: return (319ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:00:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:00:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'flavor' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:00:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:00:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:00:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:00:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:00:59 user nova-compute[71312]: INFO nova.compute.manager [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] instance snapshotting
Apr 14 06:00:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Beginning live snapshot process
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json -f qcow2 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjm07bjje/4378d7ae93cd43bb9b629c29e9b65911.delta 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjm07bjje/4378d7ae93cd43bb9b629c29e9b65911.delta 1073741824" returned: 0 in 0.062s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 06:01:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-changed-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Refreshing instance network info cache due to event network-changed-6a6b02b3-33b5-4330-9fa9-036ff4c19650. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] Acquiring lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] Acquired lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:01:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Refreshing network info cache for port 6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:01:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updated VIF entry in instance network info cache for port 6a6b02b3-33b5-4330-9fa9-036ff4c19650. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:01:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updating instance_info_cache with network_info: [{"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:01:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] Releasing lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:01:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 06:01:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71312) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 06:01:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 06:01:02 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 06:01:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjm07bjje/4378d7ae93cd43bb9b629c29e9b65911.delta /opt/stack/data/nova/instances/snapshots/tmpjm07bjje/4378d7ae93cd43bb9b629c29e9b65911 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjm07bjje/4378d7ae93cd43bb9b629c29e9b65911.delta /opt/stack/data/nova/instances/snapshots/tmpjm07bjje/4378d7ae93cd43bb9b629c29e9b65911" returned: 0 in 0.265s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Snapshot extracted, beginning image upload
Apr 14 06:01:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Snapshot image upload complete
Apr 14 06:01:04 user nova-compute[71312]: INFO nova.compute.manager [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Took 4.81 seconds to snapshot the instance on the hypervisor.
Apr 14 06:01:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:01:09 user nova-compute[71312]: INFO nova.compute.claims [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Claim successful on node user
Apr 14 06:01:09 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:01:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:01:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:01:09 user nova-compute[71312]: INFO nova.virt.block_device [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Booting with volume 067a7ca8-6d68-40e7-8a27-bedd09b89208 at /dev/vda
Apr 14 06:01:09 user nova-compute[71312]: DEBUG os_brick.utils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:01:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23814a35-2357-4667-b8bd-b90689174f60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG nova.policy [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b75ea4d-4808-42e2-b693-f91afa5737a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[746dda83-9a6e-450c-b5b1-234f4502d32c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b333e2b7-de1c-4c5d-a891-802d3127775c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:01:10 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b8e143-14f1-4263-a495-3cf6732692f0]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG os_brick.utils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updating existing volume attachment record: 79592b23-a654-44ac-a13d-60a7067f94d9 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Successfully created port: 0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Successfully updated port: 0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquired lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-changed-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Refreshing instance network info cache due to event network-changed-0f49c87f-7d73-49ea-9910-4bed42d15edf. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] Acquiring lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:01:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updating instance_info_cache with network_info: [{"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Releasing lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Instance network_info: |[{"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] Acquired lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Refreshing network info cache for port 0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updated VIF entry in instance network info cache for port 0f49c87f-7d73-49ea-9910-4bed42d15edf. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updating instance_info_cache with network_info: [{"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] Releasing lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:13 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:01:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:01:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:01:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Creating image(s)
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Ensure instance console log exists: /opt/stack/data/nova/instances/de510bdc-eedf-4497-82e4-15ebfaa9c7a7/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Start _get_guest_xml network_info=[{"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '79592b23-a654-44ac-a13d-60a7067f94d9', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsYhJkAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de510bdc-eedf-4497-82e4-15ebfaa9c7a7', 'attached_at': '', 'detached_at': '', 'volume_id': '067a7ca8-6d68-40e7-8a27-bedd09b89208', 'serial': '067a7ca8-6d68-40e7-8a27-bedd09b89208'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:01:14 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:01:14 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsYhJkAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:01:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:01:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:01:14 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:01:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:01:14 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:01:14 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd2d68c-9ad7-4aa7-a46a-0e8def98e90d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:01:15 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05e03a-a525-4435-b77b-85285e39cab1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208] added
Apr 14 06:01:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ac363e-8fe8-4e12-839b-7bd9d217beb4]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d5c516-231e-46d5-9a3a-80812c332347]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsYhJkAl {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsYhJkAl" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77793f1-692c-4bec-84d3-607fa22d38ca]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RsYhJkAl'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ced153-0f11-457a-a1b6-b67bd3e85691]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[169d535c-b550-4082-9d3f-518081aa3cfa]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:15 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:15 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180e369-f305-4e54-acd4-dc9261905c23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208, portal: 172.16.0.220,3260]
Apr 14 06:01:15 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208, portal: 172.16.0.220,3260] successful.
Apr 14 06:01:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[40453641-786c-47ac-bfc3-b1084afb3709]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b768fc-19dd-4d75-b617-3b52abf54c79]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:15 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:15 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:15 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:15 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:15 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8173d66b-7776-4007-a75e-288d02d0c4f3]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsYhJkAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:16 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:01:16 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7967MB free_disk=26.074859619140625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26465636138346632', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465636138346632', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance d8995825-7362-44ef-87b2-33c1f9f02e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1220323896',display_name='tempest-TestVolumeBootPattern-server-1220323896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1220323896',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-hkee341t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:01:10Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=de510bdc-eedf-4497-82e4-15ebfaa9c7a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:ee:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f49c87f-7d73-49ea-9910-4bed42d15edf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f49c87f-7d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'pci_devices' on Instance uuid de510bdc-eedf-4497-82e4-15ebfaa9c7a7 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:01:16 user nova-compute[71312]:   <uuid>de510bdc-eedf-4497-82e4-15ebfaa9c7a7</uuid>
Apr 14 06:01:16 user nova-compute[71312]:   <name>instance-0000001e</name>
Apr 14 06:01:16 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:01:16 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:01:16 user nova-compute[71312]:   <metadata>
Apr 14 06:01:16 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:01:16 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:01:16 user nova-compute[71312]:       <nova:name>tempest-TestVolumeBootPattern-server-1220323896</nova:name>
Apr 14 06:01:16 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:01:14</nova:creationTime>
Apr 14 06:01:16 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:01:16 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:01:16 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:01:16 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:01:16 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:01:16 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:01:16 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:01:16 user nova-compute[71312]:       <nova:owner>
Apr 14 06:01:16 user nova-compute[71312]:         <nova:user uuid="670c42ab26ab49808773a20f14269e13">tempest-TestVolumeBootPattern-2132265128-project-member</nova:user>
Apr 14 06:01:16 user nova-compute[71312]:         <nova:project uuid="8134d4bfff8e465c8dc0a5342fee7e10">tempest-TestVolumeBootPattern-2132265128</nova:project>
Apr 14 06:01:16 user nova-compute[71312]:       </nova:owner>
Apr 14 06:01:16 user nova-compute[71312]:       <nova:ports>
Apr 14 06:01:16 user nova-compute[71312]:         <nova:port uuid="0f49c87f-7d73-49ea-9910-4bed42d15edf">
Apr 14 06:01:16 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 06:01:16 user nova-compute[71312]:         </nova:port>
Apr 14 06:01:16 user nova-compute[71312]:       </nova:ports>
Apr 14 06:01:16 user nova-compute[71312]:     </nova:instance>
Apr 14 06:01:16 user nova-compute[71312]:   </metadata>
Apr 14 06:01:16 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:01:16 user nova-compute[71312]:     <system>
Apr 14 06:01:16 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:01:16 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:01:16 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:01:16 user nova-compute[71312]:       <entry name="serial">de510bdc-eedf-4497-82e4-15ebfaa9c7a7</entry>
Apr 14 06:01:16 user nova-compute[71312]:       <entry name="uuid">de510bdc-eedf-4497-82e4-15ebfaa9c7a7</entry>
Apr 14 06:01:16 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:01:16 user nova-compute[71312]:     </system>
Apr 14 06:01:16 user nova-compute[71312]:   </sysinfo>
Apr 14 06:01:16 user nova-compute[71312]:   <os>
Apr 14 06:01:16 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:01:16 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:01:16 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:01:16 user nova-compute[71312]:   </os>
Apr 14 06:01:16 user nova-compute[71312]:   <features>
Apr 14 06:01:16 user nova-compute[71312]:     <acpi/>
Apr 14 06:01:16 user nova-compute[71312]:     <apic/>
Apr 14 06:01:16 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:01:16 user nova-compute[71312]:   </features>
Apr 14 06:01:16 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:01:16 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:01:16 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:01:16 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:01:16 user nova-compute[71312]:   </clock>
Apr 14 06:01:16 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:01:16 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:01:16 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:01:16 user nova-compute[71312]:   </cpu>
Apr 14 06:01:16 user nova-compute[71312]:   <devices>
Apr 14 06:01:16 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:01:16 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:01:16 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 06:01:16 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:01:16 user nova-compute[71312]:       <serial>067a7ca8-6d68-40e7-8a27-bedd09b89208</serial>
Apr 14 06:01:16 user nova-compute[71312]:     </disk>
Apr 14 06:01:16 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:01:16 user nova-compute[71312]:       <mac address="fa:16:3e:69:ee:8a"/>
Apr 14 06:01:16 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:01:16 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:01:16 user nova-compute[71312]:       <target dev="tap0f49c87f-7d"/>
Apr 14 06:01:16 user nova-compute[71312]:     </interface>
Apr 14 06:01:16 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:01:16 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/de510bdc-eedf-4497-82e4-15ebfaa9c7a7/console.log" append="off"/>
Apr 14 06:01:16 user nova-compute[71312]:     </serial>
Apr 14 06:01:16 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:01:16 user nova-compute[71312]:     <video>
Apr 14 06:01:16 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:01:16 user nova-compute[71312]:     </video>
Apr 14 06:01:16 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:01:16 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:01:16 user nova-compute[71312]:     </rng>
Apr 14 06:01:16 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:01:16 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:01:16 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:01:16 user nova-compute[71312]:     </memballoon>
Apr 14 06:01:16 user nova-compute[71312]:   </devices>
Apr 14 06:01:16 user nova-compute[71312]: </domain>
Apr 14 06:01:16 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1220323896',display_name='tempest-TestVolumeBootPattern-server-1220323896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1220323896',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-hkee341t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:01:10Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=de510bdc-eedf-4497-82e4-15ebfaa9c7a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:ee:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f49c87f-7d73-49ea-9910-4bed42d15edf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f49c87f-7d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG os_vif [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:ee:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f49c87f-7d73-49ea-9910-4bed42d15edf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f49c87f-7d') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f49c87f-7d, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f49c87f-7d, col_values=(('external_ids', {'iface-id': '0f49c87f-7d73-49ea-9910-4bed42d15edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:ee:8a', 'vm-uuid': 'de510bdc-eedf-4497-82e4-15ebfaa9c7a7'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:16 user nova-compute[71312]: INFO os_vif [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:ee:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f49c87f-7d73-49ea-9910-4bed42d15edf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f49c87f-7d')
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] No VIF found with MAC fa:16:3e:69:ee:8a, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:01:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:17 user nova-compute[71312]: INFO nova.compute.manager [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Unshelving
Apr 14 06:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'pci_requests' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'numa_topology' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:01:17 user nova-compute[71312]: INFO nova.compute.claims [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Claim successful on node user
Apr 14 06:01:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:01:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:18 user nova-compute[71312]: INFO nova.network.neutron [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating port 164b82d4-a91d-462e-9018-d6ef229e6aec with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] Acquiring lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] No waiting events found dispatching network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:01:18 user nova-compute[71312]: WARNING nova.compute.manager [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received unexpected event network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf for instance with vm_state building and task_state spawning.
Apr 14 06:01:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquired lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:01:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:01:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating instance_info_cache with network_info: [{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Releasing lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:01:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:01:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Creating image(s)
Apr 14 06:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'trusted_certs' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452080.0457525, de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:01:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] VM Resumed (Lifecycle Event)
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Acquiring lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] No waiting events found dispatching network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:01:20 user nova-compute[71312]: WARNING nova.compute.manager [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received unexpected event network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf for instance with vm_state building and task_state spawning.
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-changed-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Refreshing instance network info cache due to event network-changed-164b82d4-a91d-462e-9018-d6ef229e6aec. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Acquiring lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Acquired lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Refreshing network info cache for port 164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:01:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Instance spawned successfully.
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:01:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452080.046283, de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:01:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] VM Started (Lifecycle Event)
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba.part --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.virt.images [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] a362e793-faa0-42d7-99d9-76c1dbdc1961 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba.part /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:01:20 user nova-compute[71312]: INFO nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Took 5.91 seconds to spawn the instance on the hypervisor.
Apr 14 06:01:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:01:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba.part /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba.converted" returned: 0 in 0.304s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:21 user nova-compute[71312]: INFO nova.compute.manager [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Took 11.81 seconds to build instance.
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.906s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.352s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updated VIF entry in instance network info cache for port 164b82d4-a91d-462e-9018-d6ef229e6aec. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating instance_info_cache with network_info: [{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Releasing lock "refresh_cache-b7f31928-32b3-4d1e-bb7c-7b4799ce6439" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba,backing_fmt=raw /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba,backing_fmt=raw /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk 1073741824" returned: 0 in 0.056s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'migration_context' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Rebasing disk image.
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 -F raw /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 -F raw /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk" returned: 0 in 2.023s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Ensure instance console log exists: /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Start _get_guest_xml network_info=[{"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='91d9f25f388054608cd2ebf526367cd8',container_format='bare',created_at=2023-04-14T05:59:25Z,direct_url=<?>,disk_format='qcow2',id=a362e793-faa0-42d7-99d9-76c1dbdc1961,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1479627857-shelved',owner='a335a6c17041473ca2abf256cb30a25f',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T05:59:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:01:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:01:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='91d9f25f388054608cd2ebf526367cd8',container_format='bare',created_at=2023-04-14T05:59:25Z,direct_url=<?>,disk_format='qcow2',id=a362e793-faa0-42d7-99d9-76c1dbdc1961,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1479627857-shelved',owner='a335a6c17041473ca2abf256cb30a25f',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T05:59:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:01:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1479627857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1479627857',id=25,image_ref='a362e793-faa0-42d7-99d9-76c1dbdc1961',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-281561404',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-0fh0slm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member',shelved_at='2023-04-14T05:59:28.487405',shelved_host='user',shelved_image_id='a362e793-faa0-42d7-99d9-76c1dbdc1961'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=b7f31928-32b3-4d1e-bb7c-7b4799ce6439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'pci_devices' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:01:24 user nova-compute[71312]:   <uuid>b7f31928-32b3-4d1e-bb7c-7b4799ce6439</uuid>
Apr 14 06:01:24 user nova-compute[71312]:   <name>instance-00000019</name>
Apr 14 06:01:24 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:01:24 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:01:24 user nova-compute[71312]:   <metadata>
Apr 14 06:01:24 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:01:24 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:01:24 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1479627857</nova:name>
Apr 14 06:01:24 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:01:23</nova:creationTime>
Apr 14 06:01:24 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:01:24 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:01:24 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:01:24 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:01:24 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:01:24 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:01:24 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:01:24 user nova-compute[71312]:       <nova:owner>
Apr 14 06:01:24 user nova-compute[71312]:         <nova:user uuid="e7fece08f6f649bb89fc8ae5121bc2cc">tempest-AttachVolumeShelveTestJSON-1611001218-project-member</nova:user>
Apr 14 06:01:24 user nova-compute[71312]:         <nova:project uuid="a335a6c17041473ca2abf256cb30a25f">tempest-AttachVolumeShelveTestJSON-1611001218</nova:project>
Apr 14 06:01:24 user nova-compute[71312]:       </nova:owner>
Apr 14 06:01:24 user nova-compute[71312]:       <nova:root type="image" uuid="a362e793-faa0-42d7-99d9-76c1dbdc1961"/>
Apr 14 06:01:24 user nova-compute[71312]:       <nova:ports>
Apr 14 06:01:24 user nova-compute[71312]:         <nova:port uuid="164b82d4-a91d-462e-9018-d6ef229e6aec">
Apr 14 06:01:24 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 06:01:24 user nova-compute[71312]:         </nova:port>
Apr 14 06:01:24 user nova-compute[71312]:       </nova:ports>
Apr 14 06:01:24 user nova-compute[71312]:     </nova:instance>
Apr 14 06:01:24 user nova-compute[71312]:   </metadata>
Apr 14 06:01:24 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:01:24 user nova-compute[71312]:     <system>
Apr 14 06:01:24 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:01:24 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:01:24 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:01:24 user nova-compute[71312]:       <entry name="serial">b7f31928-32b3-4d1e-bb7c-7b4799ce6439</entry>
Apr 14 06:01:24 user nova-compute[71312]:       <entry name="uuid">b7f31928-32b3-4d1e-bb7c-7b4799ce6439</entry>
Apr 14 06:01:24 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:01:24 user nova-compute[71312]:     </system>
Apr 14 06:01:24 user nova-compute[71312]:   </sysinfo>
Apr 14 06:01:24 user nova-compute[71312]:   <os>
Apr 14 06:01:24 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:01:24 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:01:24 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:01:24 user nova-compute[71312]:   </os>
Apr 14 06:01:24 user nova-compute[71312]:   <features>
Apr 14 06:01:24 user nova-compute[71312]:     <acpi/>
Apr 14 06:01:24 user nova-compute[71312]:     <apic/>
Apr 14 06:01:24 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:01:24 user nova-compute[71312]:   </features>
Apr 14 06:01:24 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:01:24 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:01:24 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:01:24 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:01:24 user nova-compute[71312]:   </clock>
Apr 14 06:01:24 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:01:24 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:01:24 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:01:24 user nova-compute[71312]:   </cpu>
Apr 14 06:01:24 user nova-compute[71312]:   <devices>
Apr 14 06:01:24 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:01:24 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:01:24 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk"/>
Apr 14 06:01:24 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:01:24 user nova-compute[71312]:     </disk>
Apr 14 06:01:24 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:01:24 user nova-compute[71312]:       <mac address="fa:16:3e:95:73:6e"/>
Apr 14 06:01:24 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:01:24 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:01:24 user nova-compute[71312]:       <target dev="tap164b82d4-a9"/>
Apr 14 06:01:24 user nova-compute[71312]:     </interface>
Apr 14 06:01:24 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:01:24 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/console.log" append="off"/>
Apr 14 06:01:24 user nova-compute[71312]:     </serial>
Apr 14 06:01:24 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:01:24 user nova-compute[71312]:     <video>
Apr 14 06:01:24 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:01:24 user nova-compute[71312]:     </video>
Apr 14 06:01:24 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:01:24 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:01:24 user nova-compute[71312]:     </rng>
Apr 14 06:01:24 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:01:24 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:01:24 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:01:24 user nova-compute[71312]:     </memballoon>
Apr 14 06:01:24 user nova-compute[71312]:   </devices>
Apr 14 06:01:24 user nova-compute[71312]: </domain>
Apr 14 06:01:24 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1479627857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1479627857',id=25,image_ref='a362e793-faa0-42d7-99d9-76c1dbdc1961',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-281561404',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-0fh0slm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member',shelved_at='2023-04-14T05:59:28.487405',shelved_host='user',shelved_image_id='a362e793-faa0-42d7-99d9-76c1dbdc1961'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=b7f31928-32b3-4d1e-bb7c-7b4799ce6439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG os_vif [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap164b82d4-a9, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap164b82d4-a9, col_values=(('external_ids', {'iface-id': '164b82d4-a91d-462e-9018-d6ef229e6aec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:73:6e', 'vm-uuid': 'b7f31928-32b3-4d1e-bb7c-7b4799ce6439'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:24 user nova-compute[71312]: INFO os_vif [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9')
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] No VIF found with MAC fa:16:3e:95:73:6e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:01:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:01:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:01:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:01:25 user nova-compute[71312]: WARNING nova.compute.manager [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 06:01:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452087.7906933, b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:01:27 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] VM Resumed (Lifecycle Event)
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:01:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance spawned successfully.
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:01:27 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452087.794657, b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:01:27 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] VM Started (Lifecycle Event)
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:01:27 user nova-compute[71312]: WARNING nova.compute.manager [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 06:01:27 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:01:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:01:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.859s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-changed-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:01:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Refreshing instance network info cache due to event network-changed-907e4f56-85d9-4e2b-a241-f5fe7eded6fb. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:01:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] Acquiring lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:01:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] Acquired lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:01:39 user nova-compute[71312]: DEBUG nova.network.neutron [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Refreshing network info cache for port 907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:01:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Updated VIF entry in instance network info cache for port 907e4f56-85d9-4e2b-a241-f5fe7eded6fb. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:01:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Updating instance_info_cache with network_info: [{"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:01:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] Releasing lock "refresh_cache-f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG nova.objects.instance [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:42 user nova-compute[71312]: INFO nova.compute.manager [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Attaching volume a4b730f2-8ef0-4043-b861-e3b145d94f5f to /dev/vdb
Apr 14 06:01:42 user nova-compute[71312]: DEBUG os_brick.utils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95be23ba-6d0c-4c22-9b9e-cbdb807cee94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73d3114-19fb-424b-aff3-2f338ff6b1e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69eabe0-f337-4b59-a607-ea59966e11f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92ef85-12cf-4485-b33b-2810dc981d5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:01:42 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:01:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f16cee-02bf-454b-803e-75ce0e7fc16a]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG os_brick.utils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== get_connector_properties: return (251ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:01:42 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Updating existing volume attachment record: d4979dc7-477a-4423-91be-66dd501ced57 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:01:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgrYmsVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:01:47 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:01:47 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:01:47 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65c9827-0d6c-49a5-abc9-28d5a0fb3edf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:01:47 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[506c7a08-2a89-4363-9060-2e86846fb760]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f] added
Apr 14 06:01:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c378912-02d1-42d3-8a7c-593cd6bc5981]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8157cae6-1440-4fd4-904f-0685b522afe2]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgrYmsVi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgrYmsVi" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec60dec-6736-4980-8759-d1aa1ae13a79]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgrYmsVi'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[763a94c5-58f9-46f3-aa5d-06d2f9113b51]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4202984-ef00-4577-85a2-ec8995b4d26b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:47 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:47 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:47 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:47 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb7ca4a-653c-4fd3-9561-a82d041f19d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f, portal: 172.16.0.220,3260]
Apr 14 06:01:47 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f, portal: 172.16.0.220,3260] successful.
Apr 14 06:01:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16aaa0b-6b1e-4793-be69-554d766790d6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e501ad00-c6ca-43e5-85ea-79ba70a821fc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:47 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:47 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:47 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)
Apr 14 06:01:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:48 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:48 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:48 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)
Apr 14 06:01:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bc83f5-9237-47bb-9d70-3a578906eb99]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:01:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgrYmsVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23638376138343230', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638376138343230', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG nova.objects.instance [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:01:49 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:01:49 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:01:49 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:01:49 user nova-compute[71312]:   <serial>a4b730f2-8ef0-4043-b861-e3b145d94f5f</serial>
Apr 14 06:01:49 user nova-compute[71312]: </disk>
Apr 14 06:01:49 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No VIF found with MAC fa:16:3e:ad:4f:92, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:01:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.108s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:01:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:01:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:01:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:01:52 user nova-compute[71312]: INFO nova.compute.manager [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Attaching volume 924cc8d2-77f4-442e-8b3e-f04588940143 to /dev/vdc
Apr 14 06:01:53 user nova-compute[71312]: DEBUG os_brick.utils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ef0ec0-dc6b-4d96-982c-179d42e4e314]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f73a9-b73b-444e-af42-548fec4e8a65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f01640-1877-4984-86b2-0334d3780741]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca6f54e-2693-4b85-af49-853941f2eccc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:01:53 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:01:53 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ffaaa5-70db-4818-a510-763aaa887fea]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG os_brick.utils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:01:53 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Updating existing volume attachment record: 3bfcd18e-ada2-43b4-9d78-bc93409cb85c {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:01:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:01:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXqTgAon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:01:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:01:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:01:59 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf18f47-6496-4a25-8f92-d7126fa8f25f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:01:59 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6078a777-1f05-4e5b-88e9-d42ce9fc2c92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143] added
Apr 14 06:01:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e91fc6-8284-41d4-aa8a-8c52d76bd3b3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8197b5b9-6bfd-4352-920a-93a2b414fb72]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXqTgAon {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXqTgAon" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c20bec3-9aca-4a9b-a29b-049f8946067d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXqTgAon'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6258002-334c-44a3-a38c-17555b498a04]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4beb198-e5b7-4b6e-a78d-92013e7129f6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)
Apr 14 06:01:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)
Apr 14 06:01:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[555fdc02-5c88-4f2f-926c-aeaea820ee43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143, portal: 172.16.0.220,3260]
Apr 14 06:01:59 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143, portal: 172.16.0.220,3260] successful.
Apr 14 06:01:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e359ac2-b771-4534-936b-9a297502894d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[542db38f-529b-4334-8a7d-af5919ad1e11]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)
Apr 14 06:01:59 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)
Apr 14 06:01:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2eefcc-7a28-4d3c-820e-df66b2b6488c]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:01:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXqTgAon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23239316431346166', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239316431346166', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:02:00 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:00 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 06:02:00 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Apr 14 06:02:00 user nova-compute[71312]:   <serial>924cc8d2-77f4-442e-8b3e-f04588940143</serial>
Apr 14 06:02:00 user nova-compute[71312]: </disk>
Apr 14 06:02:00 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] No VIF found with MAC fa:16:3e:ad:4f:92, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:02:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.048s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:01 user nova-compute[71312]: INFO nova.compute.manager [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Detaching volume a4b730f2-8ef0-4043-b861-e3b145d94f5f
Apr 14 06:02:02 user nova-compute[71312]: INFO nova.virt.block_device [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Attempting to driver detach volume a4b730f2-8ef0-4043-b861-e3b145d94f5f from mountpoint /dev/vdb
Apr 14 06:02:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Attempting to detach device vdb from instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:02:02 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:02 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:02:02 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:02:02 user nova-compute[71312]:   <serial>a4b730f2-8ef0-4043-b861-e3b145d94f5f</serial>
Apr 14 06:02:02 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:02:02 user nova-compute[71312]: </disk>
Apr 14 06:02:02 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:02:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully detached device vdb from instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c from the persistent domain config.
Apr 14 06:02:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:02:02 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:02 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:02:02 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:02:02 user nova-compute[71312]:   <serial>a4b730f2-8ef0-4043-b861-e3b145d94f5f</serial>
Apr 14 06:02:02 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:02:02 user nova-compute[71312]: </disk>
Apr 14 06:02:02 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452122.4870741, f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:02:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully detached device vdb from instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c from the live domain config.
Apr 14 06:02:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgrYmsVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:02 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a089e376-8aeb-47d3-85fd-0fca0cebf021]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:02:02 user nova-compute[71312]: No targets found.
Apr 14 06:02:02 user nova-compute[71312]: iSNS:
Apr 14 06:02:02 user nova-compute[71312]: No targets found.
Apr 14 06:02:02 user nova-compute[71312]: STATIC:
Apr 14 06:02:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 06:02:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208
Apr 14 06:02:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f
Apr 14 06:02:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:02:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143
Apr 14 06:02:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:02 user nova-compute[71312]: FIRMWARE:
Apr 14 06:02:02 user nova-compute[71312]: No targets found.
Apr 14 06:02:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:02:02 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:02:02 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff451db-94ad-40d9-911c-a6f2d881cd06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdc1059-069a-4f70-8228-0a70a3a0bb53]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:02 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:02 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:02 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)
Apr 14 06:02:02 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)
Apr 14 06:02:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:02 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:02 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:02 user nova-compute[71312]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f (non-flash)
Apr 14 06:02:02 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)
Apr 14 06:02:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e42c6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f37bdbb-12ad-4651-9169-f0087af517d8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b84c0e5-2f61-4dbf-951a-a4a0f46dc944]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff7e62-6eac-4422-8243-516b64e312b0]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3365b226-7a86-45db-8232-4d2460dc3733]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45009fb7-b2b0-4334-a6d0-fcca34de161a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c3523c-b9a4-4dad-8703-9395e3a98249]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f, portal: 172.16.0.220,3260]
Apr 14 06:02:02 user nova-compute[71312]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f, portal: 172.16.0.220,3260] successful.
Apr 14 06:02:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b730f2-8ef0-4043-b861-e3b145d94f5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51a095f-26ce-4b15-a9e4-cd3c98be0936]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== disconnect_volume: return (321ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:02:03 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.014s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:04 user nova-compute[71312]: INFO nova.compute.manager [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Detaching volume 924cc8d2-77f4-442e-8b3e-f04588940143
Apr 14 06:02:04 user nova-compute[71312]: INFO nova.virt.block_device [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Attempting to driver detach volume 924cc8d2-77f4-442e-8b3e-f04588940143 from mountpoint /dev/vdc
Apr 14 06:02:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Attempting to detach device vdc from instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:02:04 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:04 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 06:02:04 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Apr 14 06:02:04 user nova-compute[71312]:   <serial>924cc8d2-77f4-442e-8b3e-f04588940143</serial>
Apr 14 06:02:04 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 06:02:04 user nova-compute[71312]: </disk>
Apr 14 06:02:04 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:02:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully detached device vdc from instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c from the persistent domain config.
Apr 14 06:02:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:02:04 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:04 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 06:02:04 user nova-compute[71312]:   <target dev="vdc" bus="virtio"/>
Apr 14 06:02:04 user nova-compute[71312]:   <serial>924cc8d2-77f4-442e-8b3e-f04588940143</serial>
Apr 14 06:02:04 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 06:02:04 user nova-compute[71312]: </disk>
Apr 14 06:02:04 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452124.863983, f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:02:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully detached device vdc from instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c from the live domain config.
Apr 14 06:02:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXqTgAon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:04 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca32b463-bf88-4d87-a754-39315075527f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:02:04 user nova-compute[71312]: No targets found.
Apr 14 06:02:04 user nova-compute[71312]: iSNS:
Apr 14 06:02:04 user nova-compute[71312]: No targets found.
Apr 14 06:02:04 user nova-compute[71312]: STATIC:
Apr 14 06:02:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 06:02:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:04 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208
Apr 14 06:02:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:04 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:02:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:04 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:04 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143
Apr 14 06:02:04 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:04 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:04 user nova-compute[71312]: FIRMWARE:
Apr 14 06:02:04 user nova-compute[71312]: No targets found.
Apr 14 06:02:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:02:04 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:02:04 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e6d32-73c3-45c5-a46d-b8339b44e67d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c4110a-ec24-4b5f-9e48-5d002224912c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:04 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:04 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:04 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)
Apr 14 06:02:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:04 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:04 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:04 user nova-compute[71312]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 (non-flash)
Apr 14 06:02:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e70ab7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90ccb5f-886a-4400-a81f-5b8d21b8eeef]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba6aed4-66f3-4491-a993-8da27a10f009]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:02:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29464888-8c11-42ea-a8e8-0af43d8de3d3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec97b1-6057-4c48-9b74-429ec03d1127]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc93303-8132-43e2-b37c-c951375e67b8]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3fc4e3-220b-4225-8aa0-e1f4b603305f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143, portal: 172.16.0.220,3260]
Apr 14 06:02:05 user nova-compute[71312]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143, portal: 172.16.0.220,3260] successful.
Apr 14 06:02:05 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924cc8d2-77f4-442e-8b3e-f04588940143 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d3bf56-ac8e-407c-80d2-ff498e656699]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] <== disconnect_volume: return (301ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:05 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:02:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:02:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:02:06 user nova-compute[71312]: INFO nova.compute.claims [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Claim successful on node user
Apr 14 06:02:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:02:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:02:07 user nova-compute[71312]: INFO nova.virt.block_device [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Booting with volume-backed-image 3644c9ad-79f4-4051-9ff8-56e591db88fa at /dev/vda
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.policy [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'flavor' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.256s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Successfully created port: 075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:08 user nova-compute[71312]: INFO nova.compute.manager [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Terminating instance
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-unplugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] No waiting events found dispatching network-vif-unplugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-unplugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Successfully updated port: 075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquired lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-changed-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Refreshing instance network info cache due to event network-changed-075d60ed-d208-452b-a993-da51fb4bfd77. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] Acquiring lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Instance destroyed successfully.
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'resources' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-683982699',display_name='tempest-AttachVolumeTestJSON-server-683982699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-683982699',id=28,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjST9Vq/RQ6pRTDrm1LbOsfcNfa1pbuGiC/r0eq7E3wVhoIdnwjwbWoGndyV/U8/jakU32Rad8q17apaLNEIBegaTidnfQE6Kt2hnJWaPy6aVHSpoc9Zhtwr72fSCPj9w==',key_name='tempest-keypair-597319774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c0f5758b623402393ec9eb273c7ae6f',ramdisk_id='',reservation_id='r-0awcm7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1872023683',owner_user_name='tempest-AttachVolumeTestJSON-1872023683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa9911d299b409f9ccc8a55e7b3ec5b',uuid=f06b97a7-d8e3-46e4-9e4d-3566f52ee22c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converting VIF {"id": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "address": "fa:16:3e:ad:4f:92", "network": {"id": "d288d2c3-a523-4004-913b-b2eb8a3e32c6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1783621892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0f5758b623402393ec9eb273c7ae6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907e4f56-85", "ovs_interfaceid": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:92,bridge_name='br-int',has_traffic_filtering=True,id=907e4f56-85d9-4e2b-a241-f5fe7eded6fb,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907e4f56-85') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG os_vif [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:92,bridge_name='br-int',has_traffic_filtering=True,id=907e4f56-85d9-4e2b-a241-f5fe7eded6fb,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907e4f56-85') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap907e4f56-85, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:02:09 user nova-compute[71312]: INFO os_vif [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:92,bridge_name='br-int',has_traffic_filtering=True,id=907e4f56-85d9-4e2b-a241-f5fe7eded6fb,network=Network(d288d2c3-a523-4004-913b-b2eb8a3e32c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907e4f56-85')
Apr 14 06:02:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Deleting instance files /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c_del
Apr 14 06:02:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Deletion of /opt/stack/data/nova/instances/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c_del complete
Apr 14 06:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:09 user nova-compute[71312]: INFO nova.compute.manager [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 06:02:09 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updating instance_info_cache with network_info: [{"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Releasing lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance network_info: |[{"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] Acquired lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Refreshing network info cache for port 075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:02:10 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Took 1.07 seconds to deallocate network for instance.
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updated VIF entry in instance network info cache for port 075d60ed-d208-452b-a993-da51fb4bfd77. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updating instance_info_cache with network_info: [{"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] Releasing lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] No waiting events found dispatching network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:10 user nova-compute[71312]: WARNING nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received unexpected event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance with vm_state deleted and task_state None.
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] No waiting events found dispatching network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:10 user nova-compute[71312]: WARNING nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received unexpected event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance with vm_state deleted and task_state None.
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] No waiting events found dispatching network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:10 user nova-compute[71312]: WARNING nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received unexpected event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance with vm_state deleted and task_state None.
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Acquiring lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] No waiting events found dispatching network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:10 user nova-compute[71312]: WARNING nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received unexpected event network-vif-plugged-907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance with vm_state deleted and task_state None.
Apr 14 06:02:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Received event network-vif-deleted-907e4f56-85d9-4e2b-a241-f5fe7eded6fb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:10 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Deleted allocations for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.568s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received event network-changed-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Refreshing instance network info cache due to event network-changed-3250a79a-10f7-4b4f-bd5c-a70104f878dd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] Acquiring lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] Acquired lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Refreshing network info cache for port 3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'flavor' on Instance uuid 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:11 user nova-compute[71312]: INFO nova.compute.manager [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Attaching volume 0575b5c4-2389-490d-8bb9-1e5188e5e81e to /dev/vdb
Apr 14 06:02:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updated VIF entry in instance network info cache for port 3250a79a-10f7-4b4f-bd5c-a70104f878dd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updating instance_info_cache with network_info: [{"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG os_brick.utils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] Releasing lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d283adf2-c5f9-4512-b728-052349045c99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d3e756-008e-48b6-a5c4-ff912c086ecb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b24cf3-3d86-4724-b18f-7e4ec4288b19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3b53b6-8b79-4387-8af7-1b0c470b406f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:02:12 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:02:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a79f6c6-c0b2-4994-bebf-de0bcae1bb72]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG os_brick.utils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updating existing volume attachment record: 45b75db0-f8ad-45d1-a230-8a8f4220ff22 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG os_brick.utils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b24338c-94b4-40a2-9071-80930f807c8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5327ab-47cb-4686-a2df-354e26b3dc55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[977e5cbe-69e3-4e12-8073-b18d76abc653]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc48da4-3371-4b22-a73a-a11ebe773060]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:02:13 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:02:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2af6e33-a64c-4b6b-90d1-f7a0b6bdbb4a]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG os_brick.utils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updating existing volume attachment record: 9e16e817-202b-4d3e-a1cc-521411e7cb95 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:02:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:02:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJTxKpge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:16 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:16 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:16 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa396bd-4c65-41cc-9e60-120082f5d006]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:02:16 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d8b9c-86c4-401a-89f3-42e2e4c6cbf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e] added
Apr 14 06:02:16 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e2e236-b422-4ee5-81a6-588d9eefc313]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[520b77d1-31cf-4ceb-9ba2-8345023ea33a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJTxKpge {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJTxKpge" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec06efb4-2ed3-4650-bb41-fff619f97c80]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SJTxKpge'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:17 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:02:17 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7862MB free_disk=26.07166290283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[77759e7e-1f34-4bd4-b9a3-b82b14f85b44]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9277c9ee-36ef-4478-89af-46bb8d2d4550]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae346ea6-921b-4391-9291-c62075e8c6e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e, portal: 172.16.0.220,3260]
Apr 14 06:02:17 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e, portal: 172.16.0.220,3260] successful.
Apr 14 06:02:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0089b773-d0ce-4668-8299-cdc45dbc1864]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ed64a4-5676-4a42-a53c-1294fa11977f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e (non-flash)
Apr 14 06:02:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:17 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e (non-flash)
Apr 14 06:02:17 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.678s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad3d1b8-3afe-430b-a9ce-041e858978dc]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJTxKpge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance d8995825-7362-44ef-87b2-33c1f9f02e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance e9f3555f-72fe-416f-8264-9c20053a00b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:02:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.717s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] <== connect_volume: return (1720ms) {'type': 'block', 'scsi_wwn': '26437363634303039', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437363634303039', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG nova.objects.instance [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'flavor' on Instance uuid 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:02:18 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:18 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:02:18 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:02:18 user nova-compute[71312]:   <serial>0575b5c4-2389-490d-8bb9-1e5188e5e81e</serial>
Apr 14 06:02:18 user nova-compute[71312]: </disk>
Apr 14 06:02:18 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] No VIF found with MAC fa:16:3e:53:7d:ed, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:02:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.144s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'flavor' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:19 user nova-compute[71312]: INFO nova.compute.manager [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attaching volume f1c1a968-04ba-403c-8a35-91dd18d10550 to /dev/vdb
Apr 14 06:02:19 user nova-compute[71312]: DEBUG os_brick.utils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c97766-febc-43d3-b5ef-3096290a268c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7227d8f-7368-4e7a-84ec-fd340b905502]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9683cb-5251-4612-b333-7447bc107980]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e434165-b892-4be4-81d3-fba5a1807d3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:02:19 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf07f6b-0de1-4ff1-aa8e-504eab10ce03]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG os_brick.utils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating existing volume attachment record: 3489e799-8eda-44fd-b4c7-3d48e07bff54 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:20 user nova-compute[71312]: INFO nova.compute.manager [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Detaching volume 0575b5c4-2389-490d-8bb9-1e5188e5e81e
Apr 14 06:02:20 user nova-compute[71312]: INFO nova.virt.block_device [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Attempting to driver detach volume 0575b5c4-2389-490d-8bb9-1e5188e5e81e from mountpoint /dev/vdb
Apr 14 06:02:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Attempting to detach device vdb from instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:02:20 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:20 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:02:20 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:02:20 user nova-compute[71312]:   <serial>0575b5c4-2389-490d-8bb9-1e5188e5e81e</serial>
Apr 14 06:02:20 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:02:20 user nova-compute[71312]: </disk>
Apr 14 06:02:20 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:02:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Successfully detached device vdb from instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 from the persistent domain config.
Apr 14 06:02:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:02:20 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:20 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:02:20 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:02:20 user nova-compute[71312]:   <serial>0575b5c4-2389-490d-8bb9-1e5188e5e81e</serial>
Apr 14 06:02:20 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:02:20 user nova-compute[71312]: </disk>
Apr 14 06:02:20 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452140.6736112, 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:02:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Successfully detached device vdb from instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 from the live domain config.
Apr 14 06:02:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJTxKpge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:20 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6602499c-298b-47e3-9c01-64165983567d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:02:20 user nova-compute[71312]: No targets found.
Apr 14 06:02:20 user nova-compute[71312]: iSNS:
Apr 14 06:02:20 user nova-compute[71312]: No targets found.
Apr 14 06:02:20 user nova-compute[71312]: STATIC:
Apr 14 06:02:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e
Apr 14 06:02:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:20 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 06:02:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:20 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208
Apr 14 06:02:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:20 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:02:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:20 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:20 user nova-compute[71312]: FIRMWARE:
Apr 14 06:02:20 user nova-compute[71312]: No targets found.
Apr 14 06:02:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:02:20 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:02:20 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ff53d0-fe5d-4d81-a6cc-3442f91a7f44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda742b8-9539-4fef-b358-7b30eb631864]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:20 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:20 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:20 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e (non-flash)
Apr 14 06:02:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:20 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:20 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:20 user nova-compute[71312]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e (non-flash)
Apr 14 06:02:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc213ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf10b81d-e23a-4d1a-aa3f-c79e277ea78b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0553bebc-e66c-427c-ab1b-d856fa7fe30c]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[143e2650-8118-437c-bd11-018ff179884f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5cf21f-bbc0-41b4-accd-c8811ca744d8]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f07ee74-5966-4ae6-8c1f-a9c53cd5c2fd]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ee990e-6b56-4f75-af5d-fc9cf62148e1]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e, portal: 172.16.0.220,3260]
Apr 14 06:02:20 user nova-compute[71312]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e, portal: 172.16.0.220,3260] successful.
Apr 14 06:02:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0575b5c4-2389-490d-8bb9-1e5188e5e81e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba86662c-c281-4da2-b751-45f948eaa0e5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] <== disconnect_volume: return (350ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:02:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Creating image(s)
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Ensure instance console log exists: /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Start _get_guest_xml network_info=[{"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '9e16e817-202b-4d3e-a1cc-521411e7cb95', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYGVoqOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9f3555f-72fe-416f-8264-9c20053a00b0', 'attached_at': '', 'detached_at': '', 'volume_id': '9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'serial': '9467f270-f43f-4a6e-86ba-fe82db2ec0c6'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:02:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:02:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYGVoqOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:21 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:21 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:21 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f1f81-df58-4350-aad5-22715c6b6962]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:02:21 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9281ff5-bf6d-4e14-8c4a-23fe9936076c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6] added
Apr 14 06:02:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7386b6ec-c159-4c40-aeba-b1dd2f1daf60]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bedd1cc-a786-4f26-9720-ba1ec1274d5c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYGVoqOl {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYGVoqOl" returned: 0 in 0.045s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c1f24a-9707-4d07-ae62-17dd58a0d51a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYGVoqOl'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a32ab-be54-4791-b897-6ad2070d187f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e488c3bf-607c-49c3-ad3b-ae39d30fe806]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f635cf-77af-40ed-b976-99a864e215d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6, portal: 172.16.0.220,3260]
Apr 14 06:02:21 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6, portal: 172.16.0.220,3260] successful.
Apr 14 06:02:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a667b-16b8-4f20-b5fa-657b48a44620]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f7b0a-0909-441a-b878-038989130b7b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8d13d4-88a6-4a6a-8a96-c1016c5b4120]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:02:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'flavor' on Instance uuid 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.916s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYGVoqOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23563306262393038', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563306262393038', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1234839153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1234839153',id=31,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-x3n5xvoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:02:07Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=e9f3555f-72fe-416f-8264-9c20053a00b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8e:b3,bridge_name='br-int',has_traffic_filtering=True,id=075d60ed-d208-452b-a993-da51fb4bfd77,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075d60ed-d2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'pci_devices' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:02:22 user nova-compute[71312]:   <uuid>e9f3555f-72fe-416f-8264-9c20053a00b0</uuid>
Apr 14 06:02:22 user nova-compute[71312]:   <name>instance-0000001f</name>
Apr 14 06:02:22 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:02:22 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:02:22 user nova-compute[71312]:   <metadata>
Apr 14 06:02:22 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:02:22 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:02:22 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1234839153</nova:name>
Apr 14 06:02:22 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:02:21</nova:creationTime>
Apr 14 06:02:22 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:02:22 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:02:22 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:02:22 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:02:22 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:02:22 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:02:22 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:02:22 user nova-compute[71312]:       <nova:owner>
Apr 14 06:02:22 user nova-compute[71312]:         <nova:user uuid="c4946885e01a4f0da206d796027b3c9f">tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member</nova:user>
Apr 14 06:02:22 user nova-compute[71312]:         <nova:project uuid="7034e2177823496a861a1601a5c06fe4">tempest-ServerBootFromVolumeStableRescueTest-315541711</nova:project>
Apr 14 06:02:22 user nova-compute[71312]:       </nova:owner>
Apr 14 06:02:22 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:02:22 user nova-compute[71312]:       <nova:ports>
Apr 14 06:02:22 user nova-compute[71312]:         <nova:port uuid="075d60ed-d208-452b-a993-da51fb4bfd77">
Apr 14 06:02:22 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 06:02:22 user nova-compute[71312]:         </nova:port>
Apr 14 06:02:22 user nova-compute[71312]:       </nova:ports>
Apr 14 06:02:22 user nova-compute[71312]:     </nova:instance>
Apr 14 06:02:22 user nova-compute[71312]:   </metadata>
Apr 14 06:02:22 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:02:22 user nova-compute[71312]:     <system>
Apr 14 06:02:22 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:02:22 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:02:22 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:02:22 user nova-compute[71312]:       <entry name="serial">e9f3555f-72fe-416f-8264-9c20053a00b0</entry>
Apr 14 06:02:22 user nova-compute[71312]:       <entry name="uuid">e9f3555f-72fe-416f-8264-9c20053a00b0</entry>
Apr 14 06:02:22 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:02:22 user nova-compute[71312]:     </system>
Apr 14 06:02:22 user nova-compute[71312]:   </sysinfo>
Apr 14 06:02:22 user nova-compute[71312]:   <os>
Apr 14 06:02:22 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:02:22 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:02:22 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:02:22 user nova-compute[71312]:   </os>
Apr 14 06:02:22 user nova-compute[71312]:   <features>
Apr 14 06:02:22 user nova-compute[71312]:     <acpi/>
Apr 14 06:02:22 user nova-compute[71312]:     <apic/>
Apr 14 06:02:22 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:02:22 user nova-compute[71312]:   </features>
Apr 14 06:02:22 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:02:22 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:02:22 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:02:22 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:02:22 user nova-compute[71312]:   </clock>
Apr 14 06:02:22 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:02:22 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:02:22 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:02:22 user nova-compute[71312]:   </cpu>
Apr 14 06:02:22 user nova-compute[71312]:   <devices>
Apr 14 06:02:22 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:02:22 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:22 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Apr 14 06:02:22 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:02:22 user nova-compute[71312]:       <serial>9467f270-f43f-4a6e-86ba-fe82db2ec0c6</serial>
Apr 14 06:02:22 user nova-compute[71312]:     </disk>
Apr 14 06:02:22 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:02:22 user nova-compute[71312]:       <mac address="fa:16:3e:f6:8e:b3"/>
Apr 14 06:02:22 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:02:22 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:02:22 user nova-compute[71312]:       <target dev="tap075d60ed-d2"/>
Apr 14 06:02:22 user nova-compute[71312]:     </interface>
Apr 14 06:02:22 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:02:22 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/console.log" append="off"/>
Apr 14 06:02:22 user nova-compute[71312]:     </serial>
Apr 14 06:02:22 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:02:22 user nova-compute[71312]:     <video>
Apr 14 06:02:22 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:02:22 user nova-compute[71312]:     </video>
Apr 14 06:02:22 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:02:22 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:02:22 user nova-compute[71312]:     </rng>
Apr 14 06:02:22 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:02:22 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:02:22 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:02:22 user nova-compute[71312]:     </memballoon>
Apr 14 06:02:22 user nova-compute[71312]:   </devices>
Apr 14 06:02:22 user nova-compute[71312]: </domain>
Apr 14 06:02:22 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1234839153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1234839153',id=31,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-x3n5xvoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:02:07Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=e9f3555f-72fe-416f-8264-9c20053a00b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8e:b3,bridge_name='br-int',has_traffic_filtering=True,id=075d60ed-d208-452b-a993-da51fb4bfd77,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075d60ed-d2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG os_vif [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8e:b3,bridge_name='br-int',has_traffic_filtering=True,id=075d60ed-d208-452b-a993-da51fb4bfd77,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075d60ed-d2') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap075d60ed-d2, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap075d60ed-d2, col_values=(('external_ids', {'iface-id': '075d60ed-d208-452b-a993-da51fb4bfd77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:8e:b3', 'vm-uuid': 'e9f3555f-72fe-416f-8264-9c20053a00b0'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:22 user nova-compute[71312]: INFO os_vif [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8e:b3,bridge_name='br-int',has_traffic_filtering=True,id=075d60ed-d208-452b-a993-da51fb4bfd77,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075d60ed-d2')
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No VIF found with MAC fa:16:3e:f6:8e:b3, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:02:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:23 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452128.9615963, f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:02:23 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] VM Stopped (Lifecycle Event)
Apr 14 06:02:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-48a7e64b-e07f-4e88-87b8-c2378c62a566 None None] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:24 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:24 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:24 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:24 user nova-compute[71312]: WARNING nova.compute.manager [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state building and task_state spawning.
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7816a61f-90fc-46df-9bb4-19ed40092a92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:02:24 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4c2e58-3b30-4a55-93d7-f1ca98a6ab75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550] added
Apr 14 06:02:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25a055-c9ba-4468-9860-9f353eab7ae9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17040c0-e0eb-405e-a56b-4467ab3fffd5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szEaYSAh {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szEaYSAh" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[846056af-afd7-4eb0-ae7b-099a693ba97b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'szEaYSAh'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcc63a9-a5f7-4211-871e-6d7e5cf4dd1b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41eccea-cfd3-4d81-88c2-ba2c67359126]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[618d4f8d-97f0-4892-80cb-fd2638425ffb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]
Apr 14 06:02:24 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.
Apr 14 06:02:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5b84b7-bab3-4b40-8f40-b338241a3522]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c234e-bd00-4c9a-8abf-02b8d1097321]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:02:24 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[48be254d-5854-42b7-8f49-0c2afaba0d51]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:02:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '26634356665306335', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634356665306335', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'flavor' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:02:25 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:25 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 06:02:25 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:02:25 user nova-compute[71312]:   <serial>f1c1a968-04ba-403c-8a35-91dd18d10550</serial>
Apr 14 06:02:25 user nova-compute[71312]: </disk>
Apr 14 06:02:25 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No VIF found with MAC fa:16:3e:6e:2e:0e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:26 user nova-compute[71312]: WARNING nova.compute.manager [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state building and task_state spawning.
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452146.5547383, e9f3555f-72fe-416f-8264-9c20053a00b0 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:02:26 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] VM Resumed (Lifecycle Event)
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.043s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance spawned successfully.
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:26 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452146.5576932, e9f3555f-72fe-416f-8264-9c20053a00b0 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:02:26 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] VM Started (Lifecycle Event)
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:02:26 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:02:26 user nova-compute[71312]: INFO nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 14 06:02:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:26 user nova-compute[71312]: INFO nova.compute.manager [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Took 20.15 seconds to build instance.
Apr 14 06:02:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.266s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:02:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:02:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Stashing vm_state: active {{(pid=71312) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_requests' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:02:29 user nova-compute[71312]: INFO nova.compute.claims [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Claim successful on node user
Apr 14 06:02:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'resources' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:29 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating resource usage from migration 33a67512-87c5-4845-b4b4-f4151bdaa197
Apr 14 06:02:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.482s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:29 user nova-compute[71312]: INFO nova.compute.manager [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Migrating
Apr 14 06:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:02:29 user nova-compute[71312]: INFO nova.compute.rpcapi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 06:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:02:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Starting migrate_disk_and_power_off {{(pid=71312) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:30 user nova-compute[71312]: WARNING nova.compute.manager [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state resize_migrating.
Apr 14 06:02:31 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance destroyed successfully.
Apr 14 06:02:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:02:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:6e:2e:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:6e:2e:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_vif [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98a0c510-de, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:02:31 user nova-compute[71312]: INFO os_vif [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de')
Apr 14 06:02:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:31 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ee1706-2f03-44aa-bfe3-88419d5859ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:02:31 user nova-compute[71312]: No targets found.
Apr 14 06:02:31 user nova-compute[71312]: iSNS:
Apr 14 06:02:31 user nova-compute[71312]: No targets found.
Apr 14 06:02:31 user nova-compute[71312]: STATIC:
Apr 14 06:02:31 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:02:31 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:31 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:31 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 06:02:31 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:31 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:31 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208
Apr 14 06:02:31 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:31 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:31 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:02:31 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:31 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:31 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:02:31 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:02:31 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:02:31 user nova-compute[71312]: FIRMWARE:
Apr 14 06:02:31 user nova-compute[71312]: No targets found.
Apr 14 06:02:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:02:31 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:02:31 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5be17b-3547-431f-a612-c9671b5d2c88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafd001-cd00-495e-8824-bc050951cccf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:31 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:31 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:31 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:31 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:02:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:31 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:31 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:31 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:31 user nova-compute[71312]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:02:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc1ade10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27f5a04-1bb9-47ab-a936-e124648836e1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0d32ca-a46d-4d71-974d-a4bc2f49313f]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19fd527-e621-4fd9-95de-6ee4c05f5059]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[79461c3a-52e2-42cb-b0ea-8ad7fd83abe5]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6025a8-e6ff-47b7-acc1-0a4eab4b457a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[537889d1-bf71-40e5-aee8-2a04a977698e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]
Apr 14 06:02:31 user nova-compute[71312]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.
Apr 14 06:02:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8dabbd-6b5f-4fa9-b3ac-9873d36df054]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== disconnect_volume: return (381ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:02:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187_resize/disk /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "cp -r /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187_resize/disk /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk" returned: 0 in 0.263s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187_resize/disk.info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk.info {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "cp -r /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187_resize/disk.info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk.info" returned: 0 in 0.037s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:32 user nova-compute[71312]: WARNING nova.compute.manager [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state resize_migrating.
Apr 14 06:02:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Port 98a0c510-de09-47fb-b8cc-7a053b97eb82 binding to destination host user is already ACTIVE {{(pid=71312) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 06:02:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:02:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:02:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG os_brick.utils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6f247-0407-465f-93ac-fb9472eb6c17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c2bd27-76cc-468d-9315-cfeba1c38250]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cddbfaf-e1be-4f58-8013-0588eb15d84c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70fd87b-313b-4c4e-91a7-6c3bdc4c91a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:02:35 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:02:35 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dd1bed-2561-4c09-bfcc-74d5854d9f0f]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:02:35 user nova-compute[71312]: DEBUG os_brick.utils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:02:39 user nova-compute[71312]: INFO nova.compute.claims [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Claim successful on node user
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:02:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.policy [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44c8bc2bd90742dab8b74d340bd9d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ed03c728ca4f37b84f644a501f3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:02:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Creating image(s)
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "/opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "/opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "/opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk 1073741824" returned: 0 in 0.051s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Cannot resize image /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'migration_context' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Ensure instance console log exists: /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Successfully created port: 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Starting finish_migration {{(pid=71312) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 06:02:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Creating image(s)
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Successfully updated port: 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquired lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-changed-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Refreshing instance network info cache due to event network-changed-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] Acquiring lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Cannot resize image /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Ensure instance console log exists: /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Start _get_guest_xml network_info=[{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:6e:2e:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'e0f3cd2b-83d8-42df-84f9-839b47174bb7', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187', 'attached_at': '2023-04-14T06:02:41.000000', 'detached_at': '', 'volume_id': 'f1c1a968-04ba-403c-8a35-91dd18d10550', 'serial': 'f1c1a968-04ba-403c-8a35-91dd18d10550'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:02:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:02:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:02:41 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:41 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:02:41 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdb1050-de4c-4db7-a91b-76216795e7ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:02:41 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7fe55b-c49b-41e2-b144-3c0ebac39a1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550] added
Apr 14 06:02:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1edad9-2791-40f6-a00a-57cb6731b163]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec8b2a1-fb89-4393-b059-0ecbd056c1ed]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szEaYSAh {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szEaYSAh" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa823d-ad40-4e89-9ba6-9ceeab96d10f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'szEaYSAh'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating instance_info_cache with network_info: [{"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9203ca-a1ff-4fcd-855d-e126cbef62b1]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Releasing lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Instance network_info: |[{"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] Acquired lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.neutron [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Refreshing network info cache for port 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Start _get_guest_xml network_info=[{"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:02:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:02:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-364162703',display_name='tempest-SnapshotDataIntegrityTests-server-364162703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-364162703',id=32,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY8ZVbsTmU4ya1X7CGgOE6pcyq/4JaVNXY5tpenUcguUdFE8Kr0l/yOIZh+Yt4iEVbu9gJoTSw/kQyo17gRa6Ht+rT1wWxHk+Zl701QDRQbrj4e5WxGPZquLRvwOzCLNQ==',key_name='tempest-SnapshotDataIntegrityTests-543536161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ed03c728ca4f37b84f644a501f3f85',ramdisk_id='',reservation_id='r-4n8zs3ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1995100522',owner_user_name='tempest-SnapshotDataIntegrityTests-1995100522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:02:40Z,user_data=None,user_id='44c8bc2bd90742dab8b74d340bd9d9b7',uuid=21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Converting VIF {"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:0c:d4,bridge_name='br-int',has_traffic_filtering=True,id=6fa2ad6f-43e9-42a0-961b-5b0b3af834fa,network=Network(6110eea6-64ff-49e4-9ef9-6b9be59a7a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa2ad6f-43') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'pci_devices' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c3316c-2d0a-4ab0-beca-636e4160f0b1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:02:41 user nova-compute[71312]:   <uuid>21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3</uuid>
Apr 14 06:02:41 user nova-compute[71312]:   <name>instance-00000020</name>
Apr 14 06:02:41 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:02:41 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:02:41 user nova-compute[71312]:   <metadata>
Apr 14 06:02:41 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:02:41 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:02:41 user nova-compute[71312]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-364162703</nova:name>
Apr 14 06:02:41 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:02:41</nova:creationTime>
Apr 14 06:02:41 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:02:41 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:02:41 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:02:41 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:02:41 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:02:41 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:02:41 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:02:41 user nova-compute[71312]:       <nova:owner>
Apr 14 06:02:41 user nova-compute[71312]:         <nova:user uuid="44c8bc2bd90742dab8b74d340bd9d9b7">tempest-SnapshotDataIntegrityTests-1995100522-project-member</nova:user>
Apr 14 06:02:41 user nova-compute[71312]:         <nova:project uuid="95ed03c728ca4f37b84f644a501f3f85">tempest-SnapshotDataIntegrityTests-1995100522</nova:project>
Apr 14 06:02:41 user nova-compute[71312]:       </nova:owner>
Apr 14 06:02:41 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:02:41 user nova-compute[71312]:       <nova:ports>
Apr 14 06:02:41 user nova-compute[71312]:         <nova:port uuid="6fa2ad6f-43e9-42a0-961b-5b0b3af834fa">
Apr 14 06:02:41 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 06:02:41 user nova-compute[71312]:         </nova:port>
Apr 14 06:02:41 user nova-compute[71312]:       </nova:ports>
Apr 14 06:02:41 user nova-compute[71312]:     </nova:instance>
Apr 14 06:02:41 user nova-compute[71312]:   </metadata>
Apr 14 06:02:41 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:02:41 user nova-compute[71312]:     <system>
Apr 14 06:02:41 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:02:41 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:02:41 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:02:41 user nova-compute[71312]:       <entry name="serial">21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3</entry>
Apr 14 06:02:41 user nova-compute[71312]:       <entry name="uuid">21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3</entry>
Apr 14 06:02:41 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:02:41 user nova-compute[71312]:     </system>
Apr 14 06:02:41 user nova-compute[71312]:   </sysinfo>
Apr 14 06:02:41 user nova-compute[71312]:   <os>
Apr 14 06:02:41 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:02:41 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:02:41 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:02:41 user nova-compute[71312]:   </os>
Apr 14 06:02:41 user nova-compute[71312]:   <features>
Apr 14 06:02:41 user nova-compute[71312]:     <acpi/>
Apr 14 06:02:41 user nova-compute[71312]:     <apic/>
Apr 14 06:02:41 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:02:41 user nova-compute[71312]:   </features>
Apr 14 06:02:41 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:02:41 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:02:41 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:02:41 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:02:41 user nova-compute[71312]:   </clock>
Apr 14 06:02:41 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:02:41 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:02:41 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:02:41 user nova-compute[71312]:   </cpu>
Apr 14 06:02:41 user nova-compute[71312]:   <devices>
Apr 14 06:02:41 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:02:41 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:02:41 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk"/>
Apr 14 06:02:41 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:02:41 user nova-compute[71312]:     </disk>
Apr 14 06:02:41 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:02:41 user nova-compute[71312]:       <mac address="fa:16:3e:ed:0c:d4"/>
Apr 14 06:02:41 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:02:41 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:02:41 user nova-compute[71312]:       <target dev="tap6fa2ad6f-43"/>
Apr 14 06:02:41 user nova-compute[71312]:     </interface>
Apr 14 06:02:41 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:02:41 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/console.log" append="off"/>
Apr 14 06:02:41 user nova-compute[71312]:     </serial>
Apr 14 06:02:41 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:02:41 user nova-compute[71312]:     <video>
Apr 14 06:02:41 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:02:41 user nova-compute[71312]:     </video>
Apr 14 06:02:41 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:02:41 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:02:41 user nova-compute[71312]:     </rng>
Apr 14 06:02:41 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:02:41 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:02:41 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:02:41 user nova-compute[71312]:     </memballoon>
Apr 14 06:02:41 user nova-compute[71312]:   </devices>
Apr 14 06:02:41 user nova-compute[71312]: </domain>
Apr 14 06:02:41 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-364162703',display_name='tempest-SnapshotDataIntegrityTests-server-364162703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-364162703',id=32,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY8ZVbsTmU4ya1X7CGgOE6pcyq/4JaVNXY5tpenUcguUdFE8Kr0l/yOIZh+Yt4iEVbu9gJoTSw/kQyo17gRa6Ht+rT1wWxHk+Zl701QDRQbrj4e5WxGPZquLRvwOzCLNQ==',key_name='tempest-SnapshotDataIntegrityTests-543536161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ed03c728ca4f37b84f644a501f3f85',ramdisk_id='',reservation_id='r-4n8zs3ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1995100522',owner_user_name='tempest-SnapshotDataIntegrityTests-1995100522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:02:40Z,user_data=None,user_id='44c8bc2bd90742dab8b74d340bd9d9b7',uuid=21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Converting VIF {"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:0c:d4,bridge_name='br-int',has_traffic_filtering=True,id=6fa2ad6f-43e9-42a0-961b-5b0b3af834fa,network=Network(6110eea6-64ff-49e4-9ef9-6b9be59a7a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa2ad6f-43') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_vif [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:0c:d4,bridge_name='br-int',has_traffic_filtering=True,id=6fa2ad6f-43e9-42a0-961b-5b0b3af834fa,network=Network(6110eea6-64ff-49e4-9ef9-6b9be59a7a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa2ad6f-43') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fa2ad6f-43, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fa2ad6f-43, col_values=(('external_ids', {'iface-id': '6fa2ad6f-43e9-42a0-961b-5b0b3af834fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:0c:d4', 'vm-uuid': '21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:41 user nova-compute[71312]: INFO os_vif [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:0c:d4,bridge_name='br-int',has_traffic_filtering=True,id=6fa2ad6f-43e9-42a0-961b-5b0b3af834fa,network=Network(6110eea6-64ff-49e4-9ef9-6b9be59a7a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa2ad6f-43')
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af158153-a914-4156-a19d-2e9f0eb687fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]
Apr 14 06:02:41 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.
Apr 14 06:02:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4deffbb-a34e-4766-ba79-a1a7d98dfd06]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No VIF found with MAC fa:16:3e:ed:0c:d4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d578c33-2243-4cf3-9e9e-9aaab35717b1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:02:41 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eb0403-02e7-4d28-8e30-fd7bbf027ed7]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:02:41 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updated VIF entry in instance network info cache for port 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.network.neutron [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating instance_info_cache with network_info: [{"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] Releasing lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26634356665306335', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634356665306335', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:6e:2e:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:6e:2e:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:02:42 user nova-compute[71312]:   <uuid>4e8ac55a-5fe7-470b-b04e-97a9f00f3187</uuid>
Apr 14 06:02:42 user nova-compute[71312]:   <name>instance-00000015</name>
Apr 14 06:02:42 user nova-compute[71312]:   <memory>196608</memory>
Apr 14 06:02:42 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:02:42 user nova-compute[71312]:   <metadata>
Apr 14 06:02:42 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:02:42 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:02:42 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestJSON-server-1862725483</nova:name>
Apr 14 06:02:42 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:02:41</nova:creationTime>
Apr 14 06:02:42 user nova-compute[71312]:       <nova:flavor name="m1.micro">
Apr 14 06:02:42 user nova-compute[71312]:         <nova:memory>192</nova:memory>
Apr 14 06:02:42 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:02:42 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:02:42 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:02:42 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:02:42 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:02:42 user nova-compute[71312]:       <nova:owner>
Apr 14 06:02:42 user nova-compute[71312]:         <nova:user uuid="290b67b22a91443fbfc829fa4e3db036">tempest-ServerActionsTestJSON-31064769-project-member</nova:user>
Apr 14 06:02:42 user nova-compute[71312]:         <nova:project uuid="dbc4321a7868464faa59341018ed747f">tempest-ServerActionsTestJSON-31064769</nova:project>
Apr 14 06:02:42 user nova-compute[71312]:       </nova:owner>
Apr 14 06:02:42 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:02:42 user nova-compute[71312]:       <nova:ports>
Apr 14 06:02:42 user nova-compute[71312]:         <nova:port uuid="98a0c510-de09-47fb-b8cc-7a053b97eb82">
Apr 14 06:02:42 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 06:02:42 user nova-compute[71312]:         </nova:port>
Apr 14 06:02:42 user nova-compute[71312]:       </nova:ports>
Apr 14 06:02:42 user nova-compute[71312]:     </nova:instance>
Apr 14 06:02:42 user nova-compute[71312]:   </metadata>
Apr 14 06:02:42 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:02:42 user nova-compute[71312]:     <system>
Apr 14 06:02:42 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:02:42 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:02:42 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:02:42 user nova-compute[71312]:       <entry name="serial">4e8ac55a-5fe7-470b-b04e-97a9f00f3187</entry>
Apr 14 06:02:42 user nova-compute[71312]:       <entry name="uuid">4e8ac55a-5fe7-470b-b04e-97a9f00f3187</entry>
Apr 14 06:02:42 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:02:42 user nova-compute[71312]:     </system>
Apr 14 06:02:42 user nova-compute[71312]:   </sysinfo>
Apr 14 06:02:42 user nova-compute[71312]:   <os>
Apr 14 06:02:42 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:02:42 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:02:42 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:02:42 user nova-compute[71312]:   </os>
Apr 14 06:02:42 user nova-compute[71312]:   <features>
Apr 14 06:02:42 user nova-compute[71312]:     <acpi/>
Apr 14 06:02:42 user nova-compute[71312]:     <apic/>
Apr 14 06:02:42 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:02:42 user nova-compute[71312]:   </features>
Apr 14 06:02:42 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:02:42 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:02:42 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:02:42 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:02:42 user nova-compute[71312]:   </clock>
Apr 14 06:02:42 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:02:42 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:02:42 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:02:42 user nova-compute[71312]:   </cpu>
Apr 14 06:02:42 user nova-compute[71312]:   <devices>
Apr 14 06:02:42 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:02:42 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:02:42 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk"/>
Apr 14 06:02:42 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:02:42 user nova-compute[71312]:     </disk>
Apr 14 06:02:42 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:02:42 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:02:42 user nova-compute[71312]:       <source dev="/dev/sdf"/>
Apr 14 06:02:42 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 06:02:42 user nova-compute[71312]:       <serial>f1c1a968-04ba-403c-8a35-91dd18d10550</serial>
Apr 14 06:02:42 user nova-compute[71312]:     </disk>
Apr 14 06:02:42 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:02:42 user nova-compute[71312]:       <mac address="fa:16:3e:6e:2e:0e"/>
Apr 14 06:02:42 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:02:42 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:02:42 user nova-compute[71312]:       <target dev="tap98a0c510-de"/>
Apr 14 06:02:42 user nova-compute[71312]:     </interface>
Apr 14 06:02:42 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:02:42 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/console.log" append="off"/>
Apr 14 06:02:42 user nova-compute[71312]:     </serial>
Apr 14 06:02:42 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:02:42 user nova-compute[71312]:     <video>
Apr 14 06:02:42 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:02:42 user nova-compute[71312]:     </video>
Apr 14 06:02:42 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:02:42 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:02:42 user nova-compute[71312]:     </rng>
Apr 14 06:02:42 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:02:42 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:02:42 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:02:42 user nova-compute[71312]:     </memballoon>
Apr 14 06:02:42 user nova-compute[71312]:   </devices>
Apr 14 06:02:42 user nova-compute[71312]: </domain>
Apr 14 06:02:42 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:6e:2e:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:6e:2e:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG os_vif [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98a0c510-de, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98a0c510-de, col_values=(('external_ids', {'iface-id': '98a0c510-de09-47fb-b8cc-7a053b97eb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2e:0e', 'vm-uuid': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:43 user nova-compute[71312]: INFO os_vif [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de')
Apr 14 06:02:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No VIF found with MAC fa:16:3e:6e:2e:0e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] No waiting events found dispatching network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:43 user nova-compute[71312]: WARNING nova.compute.manager [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received unexpected event network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance with vm_state building and task_state spawning.
Apr 14 06:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:44 user nova-compute[71312]: DEBUG nova.compute.manager [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:44 user nova-compute[71312]: WARNING nova.compute.manager [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state resize_finish.
Apr 14 06:02:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] No waiting events found dispatching network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:45 user nova-compute[71312]: WARNING nova.compute.manager [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received unexpected event network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance with vm_state building and task_state spawning.
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452151.1938434, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:02:46 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Stopped (Lifecycle Event)
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fb5ac32f-ac0a-4d1d-9309-3546881c9f51 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:02:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:02:46 user nova-compute[71312]: WARNING nova.compute.manager [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state resize_finish.
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452166.9643042, 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:02:46 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] VM Resumed (Lifecycle Event)
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:02:46 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Instance spawned successfully.
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452166.9656785, 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] VM Started (Lifecycle Event)
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Took 7.41 seconds to spawn the instance on the hypervisor.
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Took 8.19 seconds to build instance.
Apr 14 06:02:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.302s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452167.2516434, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Resumed (Lifecycle Event)
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance running successfully.
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Failed to set time: agent not configured {{(pid=71312) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] finish_migration finished successfully. {{(pid=71312) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452167.2539842, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Started (Lifecycle Event)
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:02:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:02:47 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 06:02:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 5c09efbc-4c94-4130-a927-9239420b7d37 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid d8995825-7362-44ef-87b2-33c1f9f02e56 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 909d40f9-ca97-4a34-bd3e-f9c98b27a963 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid de510bdc-eedf-4497-82e4-15ebfaa9c7a7 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "5c09efbc-4c94-4130-a927-9239420b7d37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "d8995825-7362-44ef-87b2-33c1f9f02e56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "5c09efbc-4c94-4130-a927-9239420b7d37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:02:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:02:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-changed-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Refreshing instance network info cache due to event network-changed-0f49c87f-7d73-49ea-9910-4bed42d15edf. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:03:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] Acquiring lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:03:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] Acquired lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:03:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Refreshing network info cache for port 0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG nova.network.neutron [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updated VIF entry in instance network info cache for port 0f49c87f-7d73-49ea-9910-4bed42d15edf. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG nova.network.neutron [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updating instance_info_cache with network_info: [{"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] Releasing lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-changed-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Refreshing instance network info cache due to event network-changed-0f49c87f-7d73-49ea-9910-4bed42d15edf. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] Acquiring lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] Acquired lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG nova.network.neutron [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Refreshing network info cache for port 0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:02 user nova-compute[71312]: INFO nova.compute.manager [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Terminating instance
Apr 14 06:03:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updated VIF entry in instance network info cache for port 0f49c87f-7d73-49ea-9910-4bed42d15edf. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updating instance_info_cache with network_info: [{"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] Releasing lock "refresh_cache-de510bdc-eedf-4497-82e4-15ebfaa9c7a7" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:03:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Instance destroyed successfully.
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'resources' on Instance uuid de510bdc-eedf-4497-82e4-15ebfaa9c7a7 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1220323896',display_name='tempest-TestVolumeBootPattern-server-1220323896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1220323896',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-hkee341t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:01:21Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=de510bdc-eedf-4497-82e4-15ebfaa9c7a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "address": "fa:16:3e:69:ee:8a", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f49c87f-7d", "ovs_interfaceid": "0f49c87f-7d73-49ea-9910-4bed42d15edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:ee:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f49c87f-7d73-49ea-9910-4bed42d15edf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f49c87f-7d') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_vif [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ee:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f49c87f-7d73-49ea-9910-4bed42d15edf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f49c87f-7d') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f49c87f-7d, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:03 user nova-compute[71312]: INFO os_vif [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ee:8a,bridge_name='br-int',has_traffic_filtering=True,id=0f49c87f-7d73-49ea-9910-4bed42d15edf,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f49c87f-7d')
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsYhJkAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:03:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14e461c-02c7-4b2b-8e5d-1fe25595d30a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:03:03 user nova-compute[71312]: No targets found.
Apr 14 06:03:03 user nova-compute[71312]: iSNS:
Apr 14 06:03:03 user nova-compute[71312]: No targets found.
Apr 14 06:03:03 user nova-compute[71312]: STATIC:
Apr 14 06:03:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:03:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:03:03 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:03:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 06:03:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:03:03 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:03:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208
Apr 14 06:03:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:03:03 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:03:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:03:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:03:03 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:03:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:03:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:03:03 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:03:03 user nova-compute[71312]: FIRMWARE:
Apr 14 06:03:03 user nova-compute[71312]: No targets found.
Apr 14 06:03:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:03:03 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:03:03 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d174de8f-7cc8-4335-af8d-de740e5c311a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb589ac2-d85c-4127-b786-85042173859b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:03:03 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:03:03 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:03:03 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:03:03 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:03:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:03:03 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:03:03 user nova-compute[71312]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 (non-flash)
Apr 14 06:03:03 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:03:03 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:03:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea3f5480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf8fa9-156b-47bb-97d3-4d9e0c4cae0f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d870150d-e5fd-47cb-bebb-971f44706bfa]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8074b299-431d-4b89-a79a-67ac9f317200]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc9f82f-e39b-4fa4-836e-9436234df159]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26465636138346632', '/dev/disk/by-id/scsi-1SCST_BIOa8cd27e4-deca84f27be653dc', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a8cd27e4') {{(pid=81359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 06:03:03 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26465636138346632
Apr 14 06:03:03 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa8cd27e4-deca84f27be653dc
Apr 14 06:03:03 user nova-compute[71312]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a8cd27e4
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a72dc7-8a36-414b-b927-bf1dd7b2e7e5]: (4, None) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-vif-unplugged-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Acquiring lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] No waiting events found dispatching network-vif-unplugged-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-vif-unplugged-0f49c87f-7d73-49ea-9910-4bed42d15edf for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Acquiring lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] No waiting events found dispatching network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:03:03 user nova-compute[71312]: WARNING nova.compute.manager [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received unexpected event network-vif-plugged-0f49c87f-7d73-49ea-9910-4bed42d15edf for instance with vm_state active and task_state deleting.
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc55616-3743-48b0-b67b-829a402a053a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:03:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e67b152-41a2-480e-8ce2-8740770fb77f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208, portal: 172.16.0.220,3260]
Apr 14 06:03:04 user nova-compute[71312]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208, portal: 172.16.0.220,3260] successful.
Apr 14 06:03:04 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067a7ca8-6d68-40e7-8a27-bedd09b89208 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c8bc75-7ce3-42a6-bac3-c30a29d3d01c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== disconnect_volume: return (349ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:03:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Deleting instance files /opt/stack/data/nova/instances/de510bdc-eedf-4497-82e4-15ebfaa9c7a7_del
Apr 14 06:03:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Deletion of /opt/stack/data/nova/instances/de510bdc-eedf-4497-82e4-15ebfaa9c7a7_del complete
Apr 14 06:03:04 user nova-compute[71312]: INFO nova.compute.manager [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 14 06:03:04 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:03:04 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:03:04 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Took 0.46 seconds to deallocate network for instance.
Apr 14 06:03:05 user nova-compute[71312]: INFO nova.compute.manager [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Took 0.76 seconds to detach 1 volumes for instance.
Apr 14 06:03:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:03:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:03:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:05 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Deleted allocations for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7
Apr 14 06:03:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "de510bdc-eedf-4497-82e4-15ebfaa9c7a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-20480017-cf5b-45cc-a530-fb67f2fbdee5 req-4493723a-e4a7-4ac6-9bb3-a8aa04b54059 service nova] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Received event network-vif-deleted-0f49c87f-7d73-49ea-9910-4bed42d15edf {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:07 user nova-compute[71312]: INFO nova.compute.manager [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Terminating instance
Apr 14 06:03:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:03:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-unplugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:03:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Instance destroyed successfully.
Apr 14 06:03:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'resources' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1479627857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1479627857',id=25,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj45WaFx8qIhjQPabhfxsWHA1PKIKKwtfrQJR3MqBpiqoCGN6x1pQ48FY1HRxszOWvQ149S+9eT9WsV7wUAXKXME2zAw5wX99IzrhcOJC2qmHxSZPdB5oJ1T5winHfSMw==',key_name='tempest-keypair-281561404',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a335a6c17041473ca2abf256cb30a25f',ramdisk_id='',reservation_id='r-0fh0slm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1611001218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1611001218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7fece08f6f649bb89fc8ae5121bc2cc',uuid=b7f31928-32b3-4d1e-bb7c-7b4799ce6439,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converting VIF {"id": "164b82d4-a91d-462e-9018-d6ef229e6aec", "address": "fa:16:3e:95:73:6e", "network": {"id": "77dc8e6f-e239-4937-ad9a-eb68543f6e86", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1878186759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a335a6c17041473ca2abf256cb30a25f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164b82d4-a9", "ovs_interfaceid": "164b82d4-a91d-462e-9018-d6ef229e6aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG os_vif [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap164b82d4-a9, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:08 user nova-compute[71312]: INFO os_vif [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:73:6e,bridge_name='br-int',has_traffic_filtering=True,id=164b82d4-a91d-462e-9018-d6ef229e6aec,network=Network(77dc8e6f-e239-4937-ad9a-eb68543f6e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164b82d4-a9')
Apr 14 06:03:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Deleting instance files /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439_del
Apr 14 06:03:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Deletion of /opt/stack/data/nova/instances/b7f31928-32b3-4d1e-bb7c-7b4799ce6439_del complete
Apr 14 06:03:08 user nova-compute[71312]: INFO nova.compute.manager [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 06:03:08 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:03:08 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:03:09 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Took 0.85 seconds to deallocate network for instance.
Apr 14 06:03:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-8a74efe9-dbc4-4a5a-bafe-d39aebc0ef66 req-de47672f-b0d2-4ba8-bdc8-3bb1fd603356 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-deleted-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:09 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Deleted allocations for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439
Apr 14 06:03:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] Acquiring lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] Lock "b7f31928-32b3-4d1e-bb7c-7b4799ce6439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] No waiting events found dispatching network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:03:09 user nova-compute[71312]: WARNING nova.compute.manager [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Received unexpected event network-vif-plugged-164b82d4-a91d-462e-9018-d6ef229e6aec for instance with vm_state deleted and task_state None.
Apr 14 06:03:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:11 user nova-compute[71312]: INFO nova.compute.manager [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Terminating instance
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received event network-changed-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Refreshing instance network info cache due to event network-changed-3250a79a-10f7-4b4f-bd5c-a70104f878dd. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] Acquiring lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] Acquired lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Refreshing network info cache for port 3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Instance destroyed successfully.
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'resources' on Instance uuid 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-78804805',display_name='tempest-TestStampPattern-server-78804805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-78804805',id=29,image_ref='4cbeb851-7902-440c-b088-480ecfc4ac6a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcG2b0c5lB1OTtRptiZOYLsv66c2YAO6Emth1PUn8sXGE4GHBGxeL8wBPcM1Lm0S0rTUfPzymAH0yKo7CcszDhOuQKdNtWzOBHBlEzaLALbxv6+KJBJZLkYLwUsiabyhg==',key_name='tempest-TestStampPattern-1286641636',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad1d1e07cab842139c5a42a9f98a0de3',ramdisk_id='',reservation_id='r-mfhamcla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='54eb0cb5-4998-4afe-9312-e7a3ea009d05',image_min_disk='1',image_min_ram='0',image_owner_id='ad1d1e07cab842139c5a42a9f98a0de3',image_owner_project_name='tempest-TestStampPattern-43185348',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-43185348-project-member',image_user_id='80e1861ede2547f1b3051829eaef8b7b',owner_project_name='tempest-TestStampPattern-43185348',owner_user_name='tempest-TestStampPattern-43185348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:00:25Z,user_data=None,user_id='80e1861ede2547f1b3051829eaef8b7b',uuid=3f1c0a57-5272-4d8e-a1d7-204c843a1a22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converting VIF {"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=3250a79a-10f7-4b4f-bd5c-a70104f878dd,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3250a79a-10') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG os_vif [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=3250a79a-10f7-4b4f-bd5c-a70104f878dd,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3250a79a-10') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3250a79a-10, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:11 user nova-compute[71312]: INFO os_vif [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=3250a79a-10f7-4b4f-bd5c-a70104f878dd,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3250a79a-10')
Apr 14 06:03:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Deleting instance files /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22_del
Apr 14 06:03:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Deletion of /opt/stack/data/nova/instances/3f1c0a57-5272-4d8e-a1d7-204c843a1a22_del complete
Apr 14 06:03:11 user nova-compute[71312]: INFO nova.compute.manager [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 06:03:11 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:03:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:03:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updated VIF entry in instance network info cache for port 3250a79a-10f7-4b4f-bd5c-a70104f878dd. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:03:12 user nova-compute[71312]: DEBUG nova.network.neutron [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updating instance_info_cache with network_info: [{"id": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "address": "fa:16:3e:53:7d:ed", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3250a79a-10", "ovs_interfaceid": "3250a79a-10f7-4b4f-bd5c-a70104f878dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:03:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] Releasing lock "refresh_cache-3f1c0a57-5272-4d8e-a1d7-204c843a1a22" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:03:12 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:03:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:12 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Took 0.95 seconds to deallocate network for instance.
Apr 14 06:03:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-dd7b4db8-e054-42ac-9269-4bf4efcc1f63 req-acd5d309-e60f-4c38-a89b-28e2e465bc84 service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received event network-vif-deleted-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:13 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Deleted allocations for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22
Apr 14 06:03:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received event network-vif-unplugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] No waiting events found dispatching network-vif-unplugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:03:13 user nova-compute[71312]: WARNING nova.compute.manager [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received unexpected event network-vif-unplugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance with vm_state deleted and task_state None.
Apr 14 06:03:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received event network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Acquiring lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] No waiting events found dispatching network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:03:13 user nova-compute[71312]: WARNING nova.compute.manager [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Received unexpected event network-vif-plugged-3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance with vm_state deleted and task_state None.
Apr 14 06:03:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "3f1c0a57-5272-4d8e-a1d7-204c843a1a22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:03:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:03:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:16 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:03:16 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:03:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=7829MB free_disk=26.03836441040039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Applying migration context for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 as it has an incoming, in-progress migration 33a67512-87c5-4845-b4b4-f4151bdaa197. Migration status is finished {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 06:03:17 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating resource usage from migration 33a67512-87c5-4845-b4b4-f4151bdaa197
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance d8995825-7362-44ef-87b2-33c1f9f02e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance e9f3555f-72fe-416f-8264-9c20053a00b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Migration 33a67512-87c5-4845-b4b4-f4151bdaa197 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:03:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.742s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:18 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452183.6880894, de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:03:18 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] VM Stopped (Lifecycle Event)
Apr 14 06:03:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-67d6fc23-30c9-4479-b3b1-7629c15416f1 None None] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:03:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:03:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:23 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452188.219797, b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:03:23 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] VM Stopped (Lifecycle Event)
Apr 14 06:03:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d96dcd55-5997-4d55-a32c-e023a3e2e7b0 None None] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:03:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:03:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:03:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:03:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:03:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:03:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:03:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 5c09efbc-4c94-4130-a927-9239420b7d37 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:03:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updating instance_info_cache with network_info: [{"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:03:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:03:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:03:26 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452191.7779167, 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:03:26 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] VM Stopped (Lifecycle Event)
Apr 14 06:03:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7eb934e4-85da-4c4a-9f0b-74372d8d1c64 None None] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:03:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:03:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:03:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:03:57 user nova-compute[71312]: INFO nova.compute.claims [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Claim successful on node user
Apr 14 06:03:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:57 user nova-compute[71312]: INFO nova.compute.manager [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Rescuing
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquired lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:03:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.policy [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updating instance_info_cache with network_info: [{"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:03:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Creating image(s)
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "/opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "/opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "/opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Releasing lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e.part --force-share --output=json" returned: 0 in 0.169s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG nova.virt.images [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 860c1218-de7d-4a5c-9ad4-d8cc754d539e was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e.part /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Successfully created port: 5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e.part /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e.converted" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:03:58 user nova-compute[71312]: WARNING nova.compute.manager [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state active and task_state rescuing.
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.791s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e,backing_fmt=raw /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance destroyed successfully.
Apr 14 06:03:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Attempting a stable device rescue
Apr 14 06:03:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 06:03:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Creating image(s)
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "/opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "/opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'trusted_certs' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "51e04d1b1b8455c4d6a4fb966c248030107ab82a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "51e04d1b1b8455c4d6a4fb966c248030107ab82a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Successfully updated port: 5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e,backing_fmt=raw /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk 1073741824" returned: 0 in 0.956s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing instance network info cache due to event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] Acquiring lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] Acquired lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG nova.network.neutron [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 1.115s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:03:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a.part --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.images [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 739fc5fe-1f68-47a9-bd9b-3ff39b4eea65 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a.part /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Cannot resize image /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'migration_context' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Ensure instance console log exists: /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] Releasing lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquired lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a.part /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a.converted" returned: 0 in 0.379s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "51e04d1b1b8455c4d6a4fb966c248030107ab82a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.428s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "51e04d1b1b8455c4d6a4fb966c248030107ab82a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "51e04d1b1b8455c4d6a4fb966c248030107ab82a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:00 user nova-compute[71312]: WARNING nova.compute.manager [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state active and task_state rescuing.
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a,backing_fmt=raw /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a,backing_fmt=raw /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue" returned: 0 in 0.198s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "51e04d1b1b8455c4d6a4fb966c248030107ab82a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'migration_context' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Start _get_guest_xml network_info=[{"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "vif_mac": "fa:16:3e:f6:8e:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '739fc5fe-1f68-47a9-bd9b-3ff39b4eea65', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '9e16e817-202b-4d3e-a1cc-521411e7cb95', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYGVoqOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e9f3555f-72fe-416f-8264-9c20053a00b0', 'attached_at': '', 'detached_at': '', 'volume_id': '9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'serial': '9467f270-f43f-4a6e-86ba-fe82db2ec0c6'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'resources' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'numa_topology' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:00 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:04:00 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:04:00 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'vcpu_model' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYGVoqOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:04:01 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:01 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:01 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[946bdba7-aa47-4b11-8145-10c3e3a25721]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UYGVoqOl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 06:04:01 user nova-compute[71312]: node.name = iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:04:01 user nova-compute[71312]: node.tpgt = -1
Apr 14 06:04:01 user nova-compute[71312]: node.startup = automatic
Apr 14 06:04:01 user nova-compute[71312]: node.leading_login = No
Apr 14 06:04:01 user nova-compute[71312]: iface.iscsi_ifacename = default
Apr 14 06:04:01 user nova-compute[71312]: iface.net_ifacename = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.ipaddress = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.prefix_len = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.hwaddress = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.transport_name = tcp
Apr 14 06:04:01 user nova-compute[71312]: iface.initiatorname = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.state = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.vlan_id = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.vlan_priority = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.vlan_state = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.iface_num = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.mtu = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.port = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.bootproto = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.subnet_mask = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.gateway = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.dhcp_alt_client_id = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.dhcp_dns = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.dhcp_learn_iqn = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.dhcp_vendor_id_state = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.dhcp_vendor_id = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.dhcp_slp_da = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.fragmentation = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.gratuitous_arp = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.incoming_forwarding = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.tos_state = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.tos = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.ttl = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.delayed_ack = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.tcp_nagle = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.tcp_wsf_state = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.tcp_wsf = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.tcp_timer_scale = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.tcp_timestamp = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.redirect = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.def_task_mgmt_timeout = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.header_digest = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.data_digest = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.immediate_data = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.initial_r2t = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.data_seq_inorder = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.data_pdu_inorder = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.erl = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.max_receive_data_len = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.first_burst_len = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.max_outstanding_r2t = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.max_burst_len = 0
Apr 14 06:04:01 user nova-compute[71312]: iface.chap_auth = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.bidi_chap = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.strict_login_compliance = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.discovery_auth = <empty>
Apr 14 06:04:01 user nova-compute[71312]: iface.discovery_logout = <empty>
Apr 14 06:04:01 user nova-compute[71312]: node.discovery_address = <empty>
Apr 14 06:04:01 user nova-compute[71312]: node.discovery_port = 0
Apr 14 06:04:01 user nova-compute[71312]: node.discovery_type = static
Apr 14 06:04:01 user nova-compute[71312]: node.session.initial_cmdsn = 0
Apr 14 06:04:01 user nova-compute[71312]: node.session.initial_login_retry_max = 8
Apr 14 06:04:01 user nova-compute[71312]: node.session.xmit_thread_priority = -20
Apr 14 06:04:01 user nova-compute[71312]: node.session.cmds_max = 128
Apr 14 06:04:01 user nova-compute[71312]: node.session.queue_depth = 32
Apr 14 06:04:01 user nova-compute[71312]: node.session.nr_sessions = 1
Apr 14 06:04:01 user nova-compute[71312]: node.session.auth.authmethod = CHAP
Apr 14 06:04:01 user nova-compute[71312]: node.session.auth.username = UYGVoqOl
Apr 14 06:04:01 user nova-compute[71312]: node.session.auth.password = ***
Apr 14 06:04:01 user nova-compute[71312]: node.session.auth.username_in = <empty>
Apr 14 06:04:01 user nova-compute[71312]: node.session.auth.password_in = <empty>
Apr 14 06:04:01 user nova-compute[71312]: node.session.auth.chap_algs = MD5
Apr 14 06:04:01 user nova-compute[71312]: node.session.timeo.replacement_timeout = 120
Apr 14 06:04:01 user nova-compute[71312]: node.session.err_timeo.abort_timeout = 15
Apr 14 06:04:01 user nova-compute[71312]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 06:04:01 user nova-compute[71312]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 06:04:01 user nova-compute[71312]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.FastAbort = Yes
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.InitialR2T = No
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.ImmediateData = Yes
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.MaxConnections = 1
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 06:04:01 user nova-compute[71312]: node.session.iscsi.ERL = 0
Apr 14 06:04:01 user nova-compute[71312]: node.session.scan = manual
Apr 14 06:04:01 user nova-compute[71312]: node.session.reopen_max = 0
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].address = 172.16.0.220
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].port = 3260
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].startup = manual
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].tcp.window_size = 524288
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].tcp.type_of_service = 0
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].timeo.logout_timeout = 15
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].timeo.login_timeout = 15
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].timeo.auth_timeout = 45
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].iscsi.DataDigest = None
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].iscsi.IFMarker = No
Apr 14 06:04:01 user nova-compute[71312]: node.conn[0].iscsi.OFMarker = No
Apr 14 06:04:01 user nova-compute[71312]: # END RECORD
Apr 14 06:04:01 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83f3682-a49b-4917-a6c5-93c65c5a1cd5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f4f2dc-6276-433b-8b6b-b8cf2518ab89]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYGVoqOl {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYGVoqOl" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17428f88-976e-4102-9c6b-dfc72e41f7a8]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYGVoqOl'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a3d5ac-d7b8-4587-bf3c-d20cc721445f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Releasing lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance network_info: |[{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8752b33e-9b55-40f4-8705-1b01833b72cc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Start _get_guest_xml network_info=[{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T06:03:54Z,direct_url=<?>,disk_format='qcow2',id=860c1218-de7d-4a5c-9ad4-d8cc754d539e,min_disk=0,min_ram=0,name='tempest-scenario-img--64358021',owner='7a4e84122c3c4cb68c55043fd3c4db35',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T06:03:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '860c1218-de7d-4a5c-9ad4-d8cc754d539e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:01 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:04:01 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:01 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:01 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:01 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:04:01 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:01 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:01 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] HCTL ('34', '0', '0', 0) found on session 34 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "d8995825-7362-44ef-87b2-33c1f9f02e56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:01 user nova-compute[71312]: INFO nova.compute.manager [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Terminating instance
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[18305d37-f643-43d4-806a-378b148ac6df]: (4, ('0 0 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Searching for a device in session 34 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYGVoqOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '23563306262393038', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563306262393038', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:04:01 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:04:01 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T06:03:54Z,direct_url=<?>,disk_format='qcow2',id=860c1218-de7d-4a5c-9ad4-d8cc754d539e,min_disk=0,min_ram=0,name='tempest-scenario-img--64358021',owner='7a4e84122c3c4cb68c55043fd3c4db35',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T06:03:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-330157663',display_name='tempest-TestMinimumBasicScenario-server-330157663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-330157663',id=33,image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVDVuZxgP6T2IopyVcHDdZNThJjwKeMuN8DramwlrXcrn8VCbcLqHqBE3vvw1uInUsIuqdv/74zpirpbQBeAoaIJz1NWGtyXXGiI15gus+WidHndaCvrtXHIBgSchsOXQ==',key_name='tempest-TestMinimumBasicScenario-231549131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-uy649w3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:03:58Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=03f4b70b-c32e-422c-856a-2edb0656df4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:04:01 user nova-compute[71312]:   <uuid>03f4b70b-c32e-422c-856a-2edb0656df4b</uuid>
Apr 14 06:04:01 user nova-compute[71312]:   <name>instance-00000021</name>
Apr 14 06:04:01 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:04:01 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:04:01 user nova-compute[71312]:   <metadata>
Apr 14 06:04:01 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:04:01 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:name>tempest-TestMinimumBasicScenario-server-330157663</nova:name>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:04:01</nova:creationTime>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:04:01 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:04:01 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:owner>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:user uuid="b59b8f9b395149c7a2eef067766f0935">tempest-TestMinimumBasicScenario-17585386-project-member</nova:user>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:project uuid="7a4e84122c3c4cb68c55043fd3c4db35">tempest-TestMinimumBasicScenario-17585386</nova:project>
Apr 14 06:04:01 user nova-compute[71312]:       </nova:owner>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:root type="image" uuid="860c1218-de7d-4a5c-9ad4-d8cc754d539e"/>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:ports>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:port uuid="5803dbac-c755-47eb-93a1-ff9e122638f9">
Apr 14 06:04:01 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 06:04:01 user nova-compute[71312]:         </nova:port>
Apr 14 06:04:01 user nova-compute[71312]:       </nova:ports>
Apr 14 06:04:01 user nova-compute[71312]:     </nova:instance>
Apr 14 06:04:01 user nova-compute[71312]:   </metadata>
Apr 14 06:04:01 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:04:01 user nova-compute[71312]:     <system>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="serial">03f4b70b-c32e-422c-856a-2edb0656df4b</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="uuid">03f4b70b-c32e-422c-856a-2edb0656df4b</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:04:01 user nova-compute[71312]:     </system>
Apr 14 06:04:01 user nova-compute[71312]:   </sysinfo>
Apr 14 06:04:01 user nova-compute[71312]:   <os>
Apr 14 06:04:01 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:04:01 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:04:01 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:04:01 user nova-compute[71312]:   </os>
Apr 14 06:04:01 user nova-compute[71312]:   <features>
Apr 14 06:04:01 user nova-compute[71312]:     <acpi/>
Apr 14 06:04:01 user nova-compute[71312]:     <apic/>
Apr 14 06:04:01 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:04:01 user nova-compute[71312]:   </features>
Apr 14 06:04:01 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:04:01 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:04:01 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:04:01 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:04:01 user nova-compute[71312]:   </clock>
Apr 14 06:04:01 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:04:01 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:04:01 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:04:01 user nova-compute[71312]:   </cpu>
Apr 14 06:04:01 user nova-compute[71312]:   <devices>
Apr 14 06:04:01 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:04:01 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:04:01 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk"/>
Apr 14 06:04:01 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:04:01 user nova-compute[71312]:     </disk>
Apr 14 06:04:01 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:04:01 user nova-compute[71312]:       <mac address="fa:16:3e:54:23:84"/>
Apr 14 06:04:01 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:04:01 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:04:01 user nova-compute[71312]:       <target dev="tap5803dbac-c7"/>
Apr 14 06:04:01 user nova-compute[71312]:     </interface>
Apr 14 06:04:01 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:04:01 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/console.log" append="off"/>
Apr 14 06:04:01 user nova-compute[71312]:     </serial>
Apr 14 06:04:01 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:04:01 user nova-compute[71312]:     <video>
Apr 14 06:04:01 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:04:01 user nova-compute[71312]:     </video>
Apr 14 06:04:01 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:04:01 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:04:01 user nova-compute[71312]:     </rng>
Apr 14 06:04:01 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:04:01 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:04:01 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:04:01 user nova-compute[71312]:     </memballoon>
Apr 14 06:04:01 user nova-compute[71312]:   </devices>
Apr 14 06:04:01 user nova-compute[71312]: </domain>
Apr 14 06:04:01 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-330157663',display_name='tempest-TestMinimumBasicScenario-server-330157663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-330157663',id=33,image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVDVuZxgP6T2IopyVcHDdZNThJjwKeMuN8DramwlrXcrn8VCbcLqHqBE3vvw1uInUsIuqdv/74zpirpbQBeAoaIJz1NWGtyXXGiI15gus+WidHndaCvrtXHIBgSchsOXQ==',key_name='tempest-TestMinimumBasicScenario-231549131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-uy649w3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:03:58Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=03f4b70b-c32e-422c-856a-2edb0656df4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG os_vif [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5803dbac-c7, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5803dbac-c7, col_values=(('external_ids', {'iface-id': '5803dbac-c755-47eb-93a1-ff9e122638f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:23:84', 'vm-uuid': '03f4b70b-c32e-422c-856a-2edb0656df4b'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1234839153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1234839153',id=31,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-x3n5xvoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:02:27Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=e9f3555f-72fe-416f-8264-9c20053a00b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "vif_mac": "fa:16:3e:f6:8e:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "vif_mac": "fa:16:3e:f6:8e:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:8e:b3,bridge_name='br-int',has_traffic_filtering=True,id=075d60ed-d208-452b-a993-da51fb4bfd77,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075d60ed-d2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'pci_devices' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:04:01 user nova-compute[71312]:   <uuid>e9f3555f-72fe-416f-8264-9c20053a00b0</uuid>
Apr 14 06:04:01 user nova-compute[71312]:   <name>instance-0000001f</name>
Apr 14 06:04:01 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:04:01 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:04:01 user nova-compute[71312]:   <metadata>
Apr 14 06:04:01 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:04:01 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1234839153</nova:name>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:04:00</nova:creationTime>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:04:01 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:04:01 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:owner>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:user uuid="c4946885e01a4f0da206d796027b3c9f">tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member</nova:user>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:project uuid="7034e2177823496a861a1601a5c06fe4">tempest-ServerBootFromVolumeStableRescueTest-315541711</nova:project>
Apr 14 06:04:01 user nova-compute[71312]:       </nova:owner>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:04:01 user nova-compute[71312]:       <nova:ports>
Apr 14 06:04:01 user nova-compute[71312]:         <nova:port uuid="075d60ed-d208-452b-a993-da51fb4bfd77">
Apr 14 06:04:01 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 06:04:01 user nova-compute[71312]:         </nova:port>
Apr 14 06:04:01 user nova-compute[71312]:       </nova:ports>
Apr 14 06:04:01 user nova-compute[71312]:     </nova:instance>
Apr 14 06:04:01 user nova-compute[71312]:   </metadata>
Apr 14 06:04:01 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:04:01 user nova-compute[71312]:     <system>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="serial">e9f3555f-72fe-416f-8264-9c20053a00b0</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="uuid">e9f3555f-72fe-416f-8264-9c20053a00b0</entry>
Apr 14 06:04:01 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:04:01 user nova-compute[71312]:     </system>
Apr 14 06:04:01 user nova-compute[71312]:   </sysinfo>
Apr 14 06:04:01 user nova-compute[71312]:   <os>
Apr 14 06:04:01 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:04:01 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:04:01 user nova-compute[71312]:   </os>
Apr 14 06:04:01 user nova-compute[71312]:   <features>
Apr 14 06:04:01 user nova-compute[71312]:     <acpi/>
Apr 14 06:04:01 user nova-compute[71312]:     <apic/>
Apr 14 06:04:01 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:04:01 user nova-compute[71312]:   </features>
Apr 14 06:04:01 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:04:01 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:04:01 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:04:01 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:04:01 user nova-compute[71312]:   </clock>
Apr 14 06:04:01 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:04:01 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:04:01 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:04:01 user nova-compute[71312]:   </cpu>
Apr 14 06:04:01 user nova-compute[71312]:   <devices>
Apr 14 06:04:01 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:04:01 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:04:01 user nova-compute[71312]:       <source dev="/dev/sdc"/>
Apr 14 06:04:01 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:04:01 user nova-compute[71312]:       <serial>9467f270-f43f-4a6e-86ba-fe82db2ec0c6</serial>
Apr 14 06:04:01 user nova-compute[71312]:     </disk>
Apr 14 06:04:01 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:04:01 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:04:01 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue"/>
Apr 14 06:04:01 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 06:04:01 user nova-compute[71312]:       <boot order="1"/>
Apr 14 06:04:01 user nova-compute[71312]:     </disk>
Apr 14 06:04:01 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:04:01 user nova-compute[71312]:       <mac address="fa:16:3e:f6:8e:b3"/>
Apr 14 06:04:01 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:04:01 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:04:01 user nova-compute[71312]:       <target dev="tap075d60ed-d2"/>
Apr 14 06:04:01 user nova-compute[71312]:     </interface>
Apr 14 06:04:01 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:04:01 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/console.log" append="off"/>
Apr 14 06:04:01 user nova-compute[71312]:     </serial>
Apr 14 06:04:01 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:04:01 user nova-compute[71312]:     <video>
Apr 14 06:04:01 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:04:01 user nova-compute[71312]:     </video>
Apr 14 06:04:01 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:04:01 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:04:01 user nova-compute[71312]:     </rng>
Apr 14 06:04:01 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:04:01 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:04:01 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:04:01 user nova-compute[71312]:     </memballoon>
Apr 14 06:04:01 user nova-compute[71312]:   </devices>
Apr 14 06:04:01 user nova-compute[71312]: </domain>
Apr 14 06:04:01 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:01 user nova-compute[71312]: INFO os_vif [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7')
Apr 14 06:04:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance destroyed successfully.
Apr 14 06:04:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] No VIF found with MAC fa:16:3e:f6:8e:b3, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No VIF found with MAC fa:16:3e:54:23:84, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-vif-unplugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] Acquiring lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] No waiting events found dispatching network-vif-unplugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-vif-unplugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Instance destroyed successfully.
Apr 14 06:04:02 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lazy-loading 'resources' on Instance uuid d8995825-7362-44ef-87b2-33c1f9f02e56 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2135968135',display_name='tempest-TestVolumeBootPattern-server-2135968135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2135968135',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew==',key_name='tempest-TestVolumeBootPattern-2009419178',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8134d4bfff8e465c8dc0a5342fee7e10',ramdisk_id='',reservation_id='r-vlgsp2xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2132265128',owner_user_name='tempest-TestVolumeBootPattern-2132265128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:59:20Z,user_data=None,user_id='670c42ab26ab49808773a20f14269e13',uuid=d8995825-7362-44ef-87b2-33c1f9f02e56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converting VIF {"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:fa:57,bridge_name='br-int',has_traffic_filtering=True,id=6a6b02b3-33b5-4330-9fa9-036ff4c19650,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b02b3-33') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_vif [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:fa:57,bridge_name='br-int',has_traffic_filtering=True,id=6a6b02b3-33b5-4330-9fa9-036ff4c19650,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b02b3-33') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a6b02b3-33, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:02 user nova-compute[71312]: INFO os_vif [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:fa:57,bridge_name='br-int',has_traffic_filtering=True,id=6a6b02b3-33b5-4330-9fa9-036ff4c19650,network=Network(452b97a0-6bab-4b84-b7ee-66bd6fb76446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b02b3-33')
Apr 14 06:04:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJvcdqOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:04:02 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[604ed9ae-f4db-41d4-a8b7-1af3454b798a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:04:02 user nova-compute[71312]: No targets found.
Apr 14 06:04:02 user nova-compute[71312]: iSNS:
Apr 14 06:04:02 user nova-compute[71312]: No targets found.
Apr 14 06:04:02 user nova-compute[71312]: STATIC:
Apr 14 06:04:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:04:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff
Apr 14 06:04:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:04:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:04:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:02 user nova-compute[71312]: FIRMWARE:
Apr 14 06:04:02 user nova-compute[71312]: No targets found.
Apr 14 06:04:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:04:02 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:04:02 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-changed-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Refreshing instance network info cache due to event network-changed-6a6b02b3-33b5-4330-9fa9-036ff4c19650. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] Acquiring lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] Acquired lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG nova.network.neutron [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Refreshing network info cache for port 6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a28bda8-3018-42fb-b149-009414e6b2a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[653ead7f-d5f4-48b1-b9d9-a934d67b5191]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:02 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:04:02 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:02 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:02 user nova-compute[71312]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff (non-flash)
Apr 14 06:04:02 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:02 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c41f9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b632fe94-3757-4152-ba3c-40dffeb6dfdd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea1cbcb-9cad-40dd-9857-2a457c2a6062]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fe2936-009f-4d19-9a34-51f72ba24e64]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7675243-6af5-4330-b60a-62628fc94dd6]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d874ab95-5104-4418-942a-6467a3964972]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a33632-5af2-4d24-aa61-78eb8ea359b2]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260]
Apr 14 06:04:03 user nova-compute[71312]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff, portal: 172.16.0.220,3260] successful.
Apr 14 06:04:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74dc3ebd-bb57-4a6a-be70-a383598ad5ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef47d086-511e-4af8-b4cd-fe6ddc97740c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] <== disconnect_volume: return (364ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:04:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Deleting instance files /opt/stack/data/nova/instances/d8995825-7362-44ef-87b2-33c1f9f02e56_del
Apr 14 06:04:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Deletion of /opt/stack/data/nova/instances/d8995825-7362-44ef-87b2-33c1f9f02e56_del complete
Apr 14 06:04:03 user nova-compute[71312]: INFO nova.compute.manager [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Took 1.98 seconds to destroy the instance on the hypervisor.
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updated VIF entry in instance network info cache for port 6a6b02b3-33b5-4330-9fa9-036ff4c19650. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updating instance_info_cache with network_info: [{"id": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "address": "fa:16:3e:46:fa:57", "network": {"id": "452b97a0-6bab-4b84-b7ee-66bd6fb76446", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1745836146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8134d4bfff8e465c8dc0a5342fee7e10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b02b3-33", "ovs_interfaceid": "6a6b02b3-33b5-4330-9fa9-036ff4c19650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] Releasing lock "refresh_cache-d8995825-7362-44ef-87b2-33c1f9f02e56" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] Acquiring lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] No waiting events found dispatching network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:03 user nova-compute[71312]: WARNING nova.compute.manager [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received unexpected event network-vif-plugged-6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance with vm_state active and task_state deleting.
Apr 14 06:04:03 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:03 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Took 0.53 seconds to deallocate network for instance.
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Received event network-vif-deleted-6a6b02b3-33b5-4330-9fa9-036ff4c19650 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] No waiting events found dispatching network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:04 user nova-compute[71312]: WARNING nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received unexpected event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 for instance with vm_state building and task_state spawning.
Apr 14 06:04:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] No waiting events found dispatching network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:04 user nova-compute[71312]: WARNING nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received unexpected event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 for instance with vm_state building and task_state spawning.
Apr 14 06:04:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:04 user nova-compute[71312]: WARNING nova.compute.manager [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state active and task_state rescuing.
Apr 14 06:04:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:06 user nova-compute[71312]: WARNING nova.compute.manager [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state active and task_state rescuing.
Apr 14 06:04:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452247.2459412, 03f4b70b-c32e-422c-856a-2edb0656df4b => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] VM Resumed (Lifecycle Event)
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance spawned successfully.
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452247.2480633, 03f4b70b-c32e-422c-856a-2edb0656df4b => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] VM Started (Lifecycle Event)
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for e9f3555f-72fe-416f-8264-9c20053a00b0 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452247.2933917, e9f3555f-72fe-416f-8264-9c20053a00b0 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] VM Resumed (Lifecycle Event)
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Took 9.49 seconds to spawn the instance on the hypervisor.
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452247.2949557, e9f3555f-72fe-416f-8264-9c20053a00b0 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] VM Started (Lifecycle Event)
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Took 10.41 seconds to build instance.
Apr 14 06:04:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.509s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:07 user nova-compute[71312]: INFO nova.compute.manager [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Took 3.81 seconds to detach 1 volumes for instance.
Apr 14 06:04:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:07 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:04:08 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:04:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:08 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Deleted allocations for instance d8995825-7362-44ef-87b2-33c1f9f02e56
Apr 14 06:04:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "d8995825-7362-44ef-87b2-33c1f9f02e56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.930s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-changed-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Refreshing instance network info cache due to event network-changed-9d24e5dc-5be4-4df3-acba-fb447e4c980a. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] Acquiring lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] Acquired lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG nova.network.neutron [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Refreshing network info cache for port 9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:10 user nova-compute[71312]: INFO nova.compute.manager [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Terminating instance
Apr 14 06:04:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updated VIF entry in instance network info cache for port 9d24e5dc-5be4-4df3-acba-fb447e4c980a. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updating instance_info_cache with network_info: [{"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] Releasing lock "refresh_cache-54eb0cb5-4998-4afe-9312-e7a3ea009d05" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-vif-unplugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] No waiting events found dispatching network-vif-unplugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-vif-unplugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:04:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Instance destroyed successfully.
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'resources' on Instance uuid 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:57:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1652264087',display_name='tempest-TestStampPattern-server-1652264087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1652264087',id=24,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcG2b0c5lB1OTtRptiZOYLsv66c2YAO6Emth1PUn8sXGE4GHBGxeL8wBPcM1Lm0S0rTUfPzymAH0yKo7CcszDhOuQKdNtWzOBHBlEzaLALbxv6+KJBJZLkYLwUsiabyhg==',key_name='tempest-TestStampPattern-1286641636',keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:57:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad1d1e07cab842139c5a42a9f98a0de3',ramdisk_id='',reservation_id='r-6rq2ogam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-43185348',owner_user_name='tempest-TestStampPattern-43185348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:00:13Z,user_data=None,user_id='80e1861ede2547f1b3051829eaef8b7b',uuid=54eb0cb5-4998-4afe-9312-e7a3ea009d05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converting VIF {"id": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "address": "fa:16:3e:b6:87:8d", "network": {"id": "854353ae-dcf2-46cd-8b84-8d47764d065c", "bridge": "br-int", "label": "tempest-TestStampPattern-1173511528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1d1e07cab842139c5a42a9f98a0de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e5dc-5b", "ovs_interfaceid": "9d24e5dc-5be4-4df3-acba-fb447e4c980a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:87:8d,bridge_name='br-int',has_traffic_filtering=True,id=9d24e5dc-5be4-4df3-acba-fb447e4c980a,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e5dc-5b') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG os_vif [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:87:8d,bridge_name='br-int',has_traffic_filtering=True,id=9d24e5dc-5be4-4df3-acba-fb447e4c980a,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e5dc-5b') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d24e5dc-5b, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:04:11 user nova-compute[71312]: INFO os_vif [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:87:8d,bridge_name='br-int',has_traffic_filtering=True,id=9d24e5dc-5be4-4df3-acba-fb447e4c980a,network=Network(854353ae-dcf2-46cd-8b84-8d47764d065c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e5dc-5b')
Apr 14 06:04:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Deleting instance files /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05_del
Apr 14 06:04:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Deletion of /opt/stack/data/nova/instances/54eb0cb5-4998-4afe-9312-e7a3ea009d05_del complete
Apr 14 06:04:11 user nova-compute[71312]: INFO nova.compute.manager [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 06:04:11 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:04:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:11 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Took 0.52 seconds to deallocate network for instance.
Apr 14 06:04:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:12 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:04:12 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:04:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:12 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Deleted allocations for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05
Apr 14 06:04:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-92a0dbb2-4ed6-4c6a-a89f-055e0764a07e req-296cf80b-530c-4ca4-aa36-061c57db5421 service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-vif-deleted-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received event network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] Acquiring lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] Lock "54eb0cb5-4998-4afe-9312-e7a3ea009d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] No waiting events found dispatching network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:13 user nova-compute[71312]: WARNING nova.compute.manager [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Received unexpected event network-vif-plugged-9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance with vm_state deleted and task_state None.
Apr 14 06:04:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:14 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:04:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:04:14 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:17 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:04:17 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8043MB free_disk=26.000919342041016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Applying migration context for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 as it has an incoming, in-progress migration 33a67512-87c5-4845-b4b4-f4151bdaa197. Migration status is finished {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 06:04:17 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating resource usage from migration 33a67512-87c5-4845-b4b4-f4151bdaa197
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance e9f3555f-72fe-416f-8264-9c20053a00b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Migration 33a67512-87c5-4845-b4b4-f4151bdaa197 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 03f4b70b-c32e-422c-856a-2edb0656df4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452242.7041798, d8995825-7362-44ef-87b2-33c1f9f02e56 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:04:17 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] VM Stopped (Lifecycle Event)
Apr 14 06:04:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-999be9ae-290f-4bc7-95df-387b64cfa256 None None] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Port 98a0c510-de09-47fb-b8cc-7a053b97eb82 binding to destination host user is already ACTIVE {{(pid=71312) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Creating tmpfile /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/tmpri14xhju to verify with other compute node that the instance is on the same shared storage. {{(pid=71312) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:19 user nova-compute[71312]: WARNING nova.compute.manager [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state resized and task_state resize_reverting.
Apr 14 06:04:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance destroyed successfully.
Apr 14 06:04:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'resources' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_vif [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98a0c510-de, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:20 user nova-compute[71312]: INFO os_vif [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de')
Apr 14 06:04:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:04:20 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.056s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[295a02a9-e7f6-4340-8ef2-1eb8af1bef89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:04:20 user nova-compute[71312]: No targets found.
Apr 14 06:04:20 user nova-compute[71312]: iSNS:
Apr 14 06:04:20 user nova-compute[71312]: No targets found.
Apr 14 06:04:20 user nova-compute[71312]: STATIC:
Apr 14 06:04:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:04:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:20 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:04:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:20 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:20 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:04:20 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:20 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:20 user nova-compute[71312]: FIRMWARE:
Apr 14 06:04:20 user nova-compute[71312]: No targets found.
Apr 14 06:04:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:04:20 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:04:20 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86020b-5ab0-496e-8111-e1880aa92899]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e44e1c3-d2c4-47ce-a549-b68898a05cbc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:20 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:20 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:20 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:20 user nova-compute[71312]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea3d1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daf3a28-6983-4013-81ba-fd357b64e9f2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4c1f4f-dd12-4fbe-b888-a8cbb81d7073]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb50d2-189f-416f-b0cd-39b9352e5be6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7d483b-250d-4da9-be35-455dd894bce6]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9f9166-742f-462d-8115-a360c5f34730]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc35f977-a3a7-4303-b0a1-1d3eb9d49e39]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]
Apr 14 06:04:20 user nova-compute[71312]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.
Apr 14 06:04:20 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a55ef6-fcea-4723-a83b-201db12c6f92]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== disconnect_volume: return (367ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:04:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'migration_context' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:04:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:22 user nova-compute[71312]: WARNING nova.compute.manager [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state resized and task_state resize_reverting.
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.332s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:22 user nova-compute[71312]: INFO nova.compute.manager [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Swapping old allocation on dict_keys(['e19fba5b-1054-4428-a84f-a1d3a8496382']) held by migration 33a67512-87c5-4845-b4b4-f4151bdaa197 for instance
Apr 14 06:04:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Overwriting current allocation {'allocations': {'e19fba5b-1054-4428-a84f-a1d3a8496382': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 39}}, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'consumer_generation': 1} on consumer 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af2366b-973b-49db-b0a2-81dc0dd64360]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ea3dd-cfc9-4aaa-952c-10f4cb932292]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b78658a-4803-4e7b-96fd-8f4ee01da845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b85296-80e2-4227-818f-c168260d7259]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:04:22 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:04:22 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3046b3f4-95f8-4d8d-8d14-a18da4475717]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:04:22 user nova-compute[71312]: DEBUG os_brick.utils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:04:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:04:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:04:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:04:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:04:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating instance_info_cache with network_info: [{"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-46ae7eba-11e8-4a56-b368-739848ed9dbc" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:04:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:04:26 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452251.3368673, 54eb0cb5-4998-4afe-9312-e7a3ea009d05 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:04:26 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] VM Stopped (Lifecycle Event)
Apr 14 06:04:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-57506395-648b-406f-802a-974b18a63696 None None] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Starting finish_revert_migration {{(pid=71312) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Start _get_guest_xml network_info=[{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '8853a411-5606-490a-a983-03c768aeee3f', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187', 'attached_at': '2023-04-14T06:04:27.000000', 'detached_at': '', 'volume_id': 'f1c1a968-04ba-403c-8a35-91dd18d10550', 'serial': 'f1c1a968-04ba-403c-8a35-91dd18d10550'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:04:27 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:04:27 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:04:27 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:27 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:27 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95bed77-bea7-4228-8781-5ff1859d5ef6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:04:27 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[816cd3bb-f34d-40dd-8f76-da94bac2fc1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550] added
Apr 14 06:04:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57eb292-dca9-45ae-b94b-ff3b36e924a3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb77522-47c8-4bab-a9bf-b2aedef54baf]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szEaYSAh {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szEaYSAh" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8501b44e-32cd-46d3-8999-3f02265f2cd0]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'szEaYSAh'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[980a3110-9f22-4cf7-a4b5-d8674569e8b2]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1c1281-2c28-4a24-a84d-06f395958920]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebed0c8-00cb-44df-b82d-4b4d09b84ae6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]
Apr 14 06:04:27 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.
Apr 14 06:04:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e933ec53-d374-4d09-b508-bca8e94386c3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847cbcd-f007-454e-a775-3925ff650cd9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3227e-befd-4734-8274-6f24ea0c684c]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:04:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26634356665306335', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634356665306335', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:04:28 user nova-compute[71312]:   <uuid>4e8ac55a-5fe7-470b-b04e-97a9f00f3187</uuid>
Apr 14 06:04:28 user nova-compute[71312]:   <name>instance-00000015</name>
Apr 14 06:04:28 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:04:28 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:04:28 user nova-compute[71312]:   <metadata>
Apr 14 06:04:28 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:04:28 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:04:28 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestJSON-server-1862725483</nova:name>
Apr 14 06:04:28 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:04:27</nova:creationTime>
Apr 14 06:04:28 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:04:28 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:04:28 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:04:28 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:04:28 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:04:28 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:04:28 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:04:28 user nova-compute[71312]:       <nova:owner>
Apr 14 06:04:28 user nova-compute[71312]:         <nova:user uuid="290b67b22a91443fbfc829fa4e3db036">tempest-ServerActionsTestJSON-31064769-project-member</nova:user>
Apr 14 06:04:28 user nova-compute[71312]:         <nova:project uuid="dbc4321a7868464faa59341018ed747f">tempest-ServerActionsTestJSON-31064769</nova:project>
Apr 14 06:04:28 user nova-compute[71312]:       </nova:owner>
Apr 14 06:04:28 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:04:28 user nova-compute[71312]:       <nova:ports>
Apr 14 06:04:28 user nova-compute[71312]:         <nova:port uuid="98a0c510-de09-47fb-b8cc-7a053b97eb82">
Apr 14 06:04:28 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 06:04:28 user nova-compute[71312]:         </nova:port>
Apr 14 06:04:28 user nova-compute[71312]:       </nova:ports>
Apr 14 06:04:28 user nova-compute[71312]:     </nova:instance>
Apr 14 06:04:28 user nova-compute[71312]:   </metadata>
Apr 14 06:04:28 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:04:28 user nova-compute[71312]:     <system>
Apr 14 06:04:28 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:04:28 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:04:28 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:04:28 user nova-compute[71312]:       <entry name="serial">4e8ac55a-5fe7-470b-b04e-97a9f00f3187</entry>
Apr 14 06:04:28 user nova-compute[71312]:       <entry name="uuid">4e8ac55a-5fe7-470b-b04e-97a9f00f3187</entry>
Apr 14 06:04:28 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:04:28 user nova-compute[71312]:     </system>
Apr 14 06:04:28 user nova-compute[71312]:   </sysinfo>
Apr 14 06:04:28 user nova-compute[71312]:   <os>
Apr 14 06:04:28 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:04:28 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:04:28 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:04:28 user nova-compute[71312]:   </os>
Apr 14 06:04:28 user nova-compute[71312]:   <features>
Apr 14 06:04:28 user nova-compute[71312]:     <acpi/>
Apr 14 06:04:28 user nova-compute[71312]:     <apic/>
Apr 14 06:04:28 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:04:28 user nova-compute[71312]:   </features>
Apr 14 06:04:28 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:04:28 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:04:28 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:04:28 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:04:28 user nova-compute[71312]:   </clock>
Apr 14 06:04:28 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:04:28 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:04:28 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:04:28 user nova-compute[71312]:   </cpu>
Apr 14 06:04:28 user nova-compute[71312]:   <devices>
Apr 14 06:04:28 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:04:28 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:04:28 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk"/>
Apr 14 06:04:28 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:04:28 user nova-compute[71312]:     </disk>
Apr 14 06:04:28 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:04:28 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:04:28 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 06:04:28 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 06:04:28 user nova-compute[71312]:       <serial>f1c1a968-04ba-403c-8a35-91dd18d10550</serial>
Apr 14 06:04:28 user nova-compute[71312]:     </disk>
Apr 14 06:04:28 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:04:28 user nova-compute[71312]:       <mac address="fa:16:3e:6e:2e:0e"/>
Apr 14 06:04:28 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:04:28 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:04:28 user nova-compute[71312]:       <target dev="tap98a0c510-de"/>
Apr 14 06:04:28 user nova-compute[71312]:     </interface>
Apr 14 06:04:28 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:04:28 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/console.log" append="off"/>
Apr 14 06:04:28 user nova-compute[71312]:     </serial>
Apr 14 06:04:28 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:04:28 user nova-compute[71312]:     <video>
Apr 14 06:04:28 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:04:28 user nova-compute[71312]:     </video>
Apr 14 06:04:28 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:04:28 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:04:28 user nova-compute[71312]:     </rng>
Apr 14 06:04:28 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:04:28 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:04:28 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:04:28 user nova-compute[71312]:     </memballoon>
Apr 14 06:04:28 user nova-compute[71312]:   </devices>
Apr 14 06:04:28 user nova-compute[71312]: </domain>
Apr 14 06:04:28 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG os_vif [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98a0c510-de, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98a0c510-de, col_values=(('external_ids', {'iface-id': '98a0c510-de09-47fb-b8cc-7a053b97eb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2e:0e', 'vm-uuid': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:04:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:29 user nova-compute[71312]: INFO os_vif [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de')
Apr 14 06:04:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:30 user nova-compute[71312]: WARNING nova.compute.manager [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state resized and task_state resize_reverting.
Apr 14 06:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452272.6714725, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:04:32 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Resumed (Lifecycle Event)
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:04:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance running successfully.
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] finish_revert_migration finished successfully. {{(pid=71312) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.compute.manager [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:04:32 user nova-compute[71312]: WARNING nova.compute.manager [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state resized and task_state resize_reverting.
Apr 14 06:04:32 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452272.673447, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:04:32 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Started (Lifecycle Event)
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:04:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:04:32 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 06:04:32 user nova-compute[71312]: INFO nova.compute.manager [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance to original state: 'active'
Apr 14 06:04:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-changed-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Refreshing instance network info cache due to event network-changed-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] Acquiring lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] Acquired lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG nova.network.neutron [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Refreshing network info cache for port 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:33 user nova-compute[71312]: INFO nova.compute.manager [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attaching volume c84d6b06-fafa-4793-a9c1-cebd22b35294 to /dev/vdb
Apr 14 06:04:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG os_brick.utils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6905518-b33e-4912-b0f9-7fa06e16fb57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6052ef-dcd5-43e9-bb5d-e03b24107e1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eaf99b-d62e-4095-a6d7-6ed66d32a042]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9577273a-736e-40ef-8ac5-b8379b190723]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updated VIF entry in instance network info cache for port 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG nova.network.neutron [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating instance_info_cache with network_info: [{"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:04:34 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[589c89ff-8d11-44a4-b2be-fc0055ae141e]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG os_brick.utils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating existing volume attachment record: 8bb5c72e-af00-4283-9fbf-5a7f90c3b841 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:04:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] Releasing lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:04:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMQyBXRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:04:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:38 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:38 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c376fa4f-05ff-4a08-a20d-b2895c83c1fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:04:38 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69a69f1-0c25-498e-b5d9-e333ddb23dee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294] added
Apr 14 06:04:38 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc324739-d2ca-46ac-8deb-53385ea92872]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72609b3d-9e99-4bab-9ee2-63eff2d58c1a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMQyBXRY {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMQyBXRY" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b443a02-351b-4f7e-96f0-421816883beb]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMQyBXRY'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[168862ec-ec50-4632-a922-46006d5aec8f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19a915d-14c9-43cf-a3d0-4d5acd8eddbd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[819fd842-7f47-4095-b3c0-e7026744b881]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294, portal: 172.16.0.220,3260]
Apr 14 06:04:39 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294, portal: 172.16.0.220,3260] successful.
Apr 14 06:04:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0ab78b-d32a-4318-894e-7bda542c3e1f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80602b-de07-4325-832b-99eddf10873b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 (non-flash)
Apr 14 06:04:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b075c3c-ca5a-47c6-b2d9-bc89266ebc7c]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:04:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMQyBXRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26266316539343436', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266316539343436', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:04:40 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:04:40 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:04:40 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:04:40 user nova-compute[71312]:   <serial>c84d6b06-fafa-4793-a9c1-cebd22b35294</serial>
Apr 14 06:04:40 user nova-compute[71312]: </disk>
Apr 14 06:04:40 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No VIF found with MAC fa:16:3e:ed:0c:d4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:04:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.879s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:04:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:04:55 user nova-compute[71312]: INFO nova.compute.manager [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Detaching volume c84d6b06-fafa-4793-a9c1-cebd22b35294
Apr 14 06:04:55 user nova-compute[71312]: INFO nova.virt.block_device [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attempting to driver detach volume c84d6b06-fafa-4793-a9c1-cebd22b35294 from mountpoint /dev/vdb
Apr 14 06:04:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Attempting to detach device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:04:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:04:55 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:04:55 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:04:55 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:04:55 user nova-compute[71312]:   <serial>c84d6b06-fafa-4793-a9c1-cebd22b35294</serial>
Apr 14 06:04:55 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:04:55 user nova-compute[71312]: </disk>
Apr 14 06:04:55 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:04:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully detached device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the persistent domain config.
Apr 14 06:04:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:04:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:04:55 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:04:55 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:04:55 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:04:55 user nova-compute[71312]:   <serial>c84d6b06-fafa-4793-a9c1-cebd22b35294</serial>
Apr 14 06:04:55 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:04:55 user nova-compute[71312]: </disk>
Apr 14 06:04:55 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452296.0961607, 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:04:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully detached device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the live domain config.
Apr 14 06:04:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMQyBXRY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:04:56 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[518a0599-9d99-4322-8f76-fe5e799c2f45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:04:56 user nova-compute[71312]: No targets found.
Apr 14 06:04:56 user nova-compute[71312]: iSNS:
Apr 14 06:04:56 user nova-compute[71312]: No targets found.
Apr 14 06:04:56 user nova-compute[71312]: STATIC:
Apr 14 06:04:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:04:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294
Apr 14 06:04:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:04:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:56 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:04:56 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:04:56 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:04:56 user nova-compute[71312]: FIRMWARE:
Apr 14 06:04:56 user nova-compute[71312]: No targets found.
Apr 14 06:04:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:04:56 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:04:56 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b30a7-30b5-4490-94ef-78cee09884b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[532f220d-f295-426c-94b3-aadc0b27ea33]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:56 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:56 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:56 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 (non-flash)
Apr 14 06:04:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:04:56 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:04:56 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:04:56 user nova-compute[71312]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 (non-flash)
Apr 14 06:04:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc2111b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ae5929-72a8-4414-bc6a-12680d3bd567]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc70a8-0a09-4942-8c9d-d438ad82a5be]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d576bd8-725f-4361-a627-0405ff4f019a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f4cc21-25dc-487b-88ff-5e7e5b64de67]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68de01-12a2-41ed-ba69-71342ac58a47]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa02949-374b-47e8-863c-5afeda394d2c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294, portal: 172.16.0.220,3260]
Apr 14 06:04:56 user nova-compute[71312]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294, portal: 172.16.0.220,3260] successful.
Apr 14 06:04:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d6b06-fafa-4793-a9c1-cebd22b35294 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec154503-414c-45c4-b94c-ef237a27786f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== disconnect_volume: return (316ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:04:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:04:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:04:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:04:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:04:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:05:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:05:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:05:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=25.97922134399414GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance e9f3555f-72fe-416f-8264-9c20053a00b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 03f4b70b-c32e-422c-856a-2edb0656df4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:05:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:05:22 user nova-compute[71312]: INFO nova.compute.claims [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Claim successful on node user
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:05:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:05:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Creating image(s)
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "/opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "/opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG nova.policy [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6991107308f4db89290f32efd2ac63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da761d3e4e148b592b6edda8197ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk 1073741824" returned: 0 in 0.050s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Cannot resize image /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lazy-loading 'migration_context' on Instance uuid 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Ensure instance console log exists: /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:23 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Successfully created port: 85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Successfully updated port: 85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "refresh_cache-6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquired lock "refresh_cache-6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received event network-changed-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Refreshing instance network info cache due to event network-changed-85a2a34f-7864-4659-90be-ecf0c970ce09. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] Acquiring lock "refresh_cache-6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Updating instance_info_cache with network_info: [{"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Releasing lock "refresh_cache-6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Instance network_info: |[{"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] Acquired lock "refresh_cache-6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.network.neutron [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Refreshing network info cache for port 85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Start _get_guest_xml network_info=[{"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:05:24 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:05:24 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1512759437',display_name='tempest-VolumesNegativeTest-instance-1512759437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1512759437',id=34,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2da761d3e4e148b592b6edda8197ce00',ramdisk_id='',reservation_id='r-74rqox9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-678118524',owner_user_name='tempest-VolumesNegativeTest-678118524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:05:23Z,user_data=None,user_id='a6991107308f4db89290f32efd2ac63e',uuid=6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Converting VIF {"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:5a:ee,bridge_name='br-int',has_traffic_filtering=True,id=85a2a34f-7864-4659-90be-ecf0c970ce09,network=Network(46f20229-cdf5-455d-abb1-1307e0429802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a2a34f-78') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:05:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:05:24 user nova-compute[71312]:   <uuid>6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf</uuid>
Apr 14 06:05:24 user nova-compute[71312]:   <name>instance-00000022</name>
Apr 14 06:05:24 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:05:24 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:05:24 user nova-compute[71312]:   <metadata>
Apr 14 06:05:24 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:05:24 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:05:24 user nova-compute[71312]:       <nova:name>tempest-VolumesNegativeTest-instance-1512759437</nova:name>
Apr 14 06:05:24 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:05:24</nova:creationTime>
Apr 14 06:05:24 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:05:24 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:05:24 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:05:24 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:05:24 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:05:24 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:05:24 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:05:24 user nova-compute[71312]:       <nova:owner>
Apr 14 06:05:24 user nova-compute[71312]:         <nova:user uuid="a6991107308f4db89290f32efd2ac63e">tempest-VolumesNegativeTest-678118524-project-member</nova:user>
Apr 14 06:05:24 user nova-compute[71312]:         <nova:project uuid="2da761d3e4e148b592b6edda8197ce00">tempest-VolumesNegativeTest-678118524</nova:project>
Apr 14 06:05:24 user nova-compute[71312]:       </nova:owner>
Apr 14 06:05:24 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:05:24 user nova-compute[71312]:       <nova:ports>
Apr 14 06:05:24 user nova-compute[71312]:         <nova:port uuid="85a2a34f-7864-4659-90be-ecf0c970ce09">
Apr 14 06:05:24 user nova-compute[71312]:           <nova:ip type="fixed" address="192.168.233.85" ipVersion="4"/>
Apr 14 06:05:24 user nova-compute[71312]:         </nova:port>
Apr 14 06:05:24 user nova-compute[71312]:       </nova:ports>
Apr 14 06:05:24 user nova-compute[71312]:     </nova:instance>
Apr 14 06:05:24 user nova-compute[71312]:   </metadata>
Apr 14 06:05:24 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:05:24 user nova-compute[71312]:     <system>
Apr 14 06:05:24 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:05:24 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:05:24 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:05:24 user nova-compute[71312]:       <entry name="serial">6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf</entry>
Apr 14 06:05:24 user nova-compute[71312]:       <entry name="uuid">6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf</entry>
Apr 14 06:05:24 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:05:24 user nova-compute[71312]:     </system>
Apr 14 06:05:24 user nova-compute[71312]:   </sysinfo>
Apr 14 06:05:24 user nova-compute[71312]:   <os>
Apr 14 06:05:24 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:05:24 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:05:24 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:05:24 user nova-compute[71312]:   </os>
Apr 14 06:05:24 user nova-compute[71312]:   <features>
Apr 14 06:05:24 user nova-compute[71312]:     <acpi/>
Apr 14 06:05:24 user nova-compute[71312]:     <apic/>
Apr 14 06:05:24 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:05:24 user nova-compute[71312]:   </features>
Apr 14 06:05:24 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:05:24 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:05:24 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:05:24 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:05:24 user nova-compute[71312]:   </clock>
Apr 14 06:05:24 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:05:24 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:05:24 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:05:24 user nova-compute[71312]:   </cpu>
Apr 14 06:05:24 user nova-compute[71312]:   <devices>
Apr 14 06:05:24 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:05:24 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:05:24 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk"/>
Apr 14 06:05:24 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:05:24 user nova-compute[71312]:     </disk>
Apr 14 06:05:24 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:05:24 user nova-compute[71312]:       <mac address="fa:16:3e:39:5a:ee"/>
Apr 14 06:05:24 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:05:24 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:05:24 user nova-compute[71312]:       <target dev="tap85a2a34f-78"/>
Apr 14 06:05:24 user nova-compute[71312]:     </interface>
Apr 14 06:05:24 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:05:24 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/console.log" append="off"/>
Apr 14 06:05:24 user nova-compute[71312]:     </serial>
Apr 14 06:05:24 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:05:24 user nova-compute[71312]:     <video>
Apr 14 06:05:24 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:05:24 user nova-compute[71312]:     </video>
Apr 14 06:05:24 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:05:24 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:05:24 user nova-compute[71312]:     </rng>
Apr 14 06:05:24 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:05:24 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:05:24 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:05:24 user nova-compute[71312]:     </memballoon>
Apr 14 06:05:24 user nova-compute[71312]:   </devices>
Apr 14 06:05:24 user nova-compute[71312]: </domain>
Apr 14 06:05:24 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1512759437',display_name='tempest-VolumesNegativeTest-instance-1512759437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1512759437',id=34,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2da761d3e4e148b592b6edda8197ce00',ramdisk_id='',reservation_id='r-74rqox9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-678118524',owner_user_name='tempest-VolumesNegativeTest-678118524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:05:23Z,user_data=None,user_id='a6991107308f4db89290f32efd2ac63e',uuid=6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Converting VIF {"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:5a:ee,bridge_name='br-int',has_traffic_filtering=True,id=85a2a34f-7864-4659-90be-ecf0c970ce09,network=Network(46f20229-cdf5-455d-abb1-1307e0429802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a2a34f-78') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG os_vif [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:5a:ee,bridge_name='br-int',has_traffic_filtering=True,id=85a2a34f-7864-4659-90be-ecf0c970ce09,network=Network(46f20229-cdf5-455d-abb1-1307e0429802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a2a34f-78') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a2a34f-78, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85a2a34f-78, col_values=(('external_ids', {'iface-id': '85a2a34f-7864-4659-90be-ecf0c970ce09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:5a:ee', 'vm-uuid': '6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:25 user nova-compute[71312]: INFO os_vif [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:5a:ee,bridge_name='br-int',has_traffic_filtering=True,id=85a2a34f-7864-4659-90be-ecf0c970ce09,network=Network(46f20229-cdf5-455d-abb1-1307e0429802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a2a34f-78')
Apr 14 06:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] No VIF found with MAC fa:16:3e:39:5a:ee, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Updated VIF entry in instance network info cache for port 85a2a34f-7864-4659-90be-ecf0c970ce09. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG nova.network.neutron [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Updating instance_info_cache with network_info: [{"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:05:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] Releasing lock "refresh_cache-6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received event network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] Acquiring lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] No waiting events found dispatching network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:05:26 user nova-compute[71312]: WARNING nova.compute.manager [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received unexpected event network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 for instance with vm_state building and task_state spawning.
Apr 14 06:05:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [{"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:05:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-4e8ac55a-5fe7-470b-b04e-97a9f00f3187" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:05:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452328.5073016, 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:05:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] VM Resumed (Lifecycle Event)
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:05:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Instance spawned successfully.
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:05:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452328.5095787, 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:05:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] VM Started (Lifecycle Event)
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:05:28 user nova-compute[71312]: INFO nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Took 5.66 seconds to spawn the instance on the hypervisor.
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:05:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received event network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] Acquiring lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] No waiting events found dispatching network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:05:28 user nova-compute[71312]: WARNING nova.compute.manager [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received unexpected event network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 for instance with vm_state building and task_state spawning.
Apr 14 06:05:28 user nova-compute[71312]: INFO nova.compute.manager [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Took 6.41 seconds to build instance.
Apr 14 06:05:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.501s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:05:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:05:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:05:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:05:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:47 user nova-compute[71312]: INFO nova.compute.manager [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Unrescuing
Apr 14 06:05:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:05:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquired lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:05:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updating instance_info_cache with network_info: [{"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Releasing lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'flavor' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:05:48 user nova-compute[71312]: WARNING nova.compute.manager [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:05:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:49 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance destroyed successfully.
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG nova.objects.instance [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:49 user nova-compute[71312]: INFO nova.compute.manager [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attaching volume 05b8da5c-e217-45e4-9a73-283be85b52c5 to /dev/vdb
Apr 14 06:05:49 user nova-compute[71312]: DEBUG os_brick.utils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f94eff-8508-4347-ae2b-37cab02c0e24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c181b0b-f8a2-4c1c-b355-a9b031a94836]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[807a1bc1-4175-4cd0-863b-baa6095c9208]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fce0e6-afcb-4b3f-80f6-df2e3d7b802c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:05:49 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:05:49 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc63c8c-2f5e-47d1-a19e-6de35d8ef2f7]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG os_brick.utils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:05:49 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating existing volume attachment record: 8a234b11-f455-4ce3-9587-011f29ec428c {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'flavor' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:05:50 user nova-compute[71312]: WARNING nova.compute.manager [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:50 user nova-compute[71312]: INFO nova.compute.manager [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Attaching volume bfc58917-7df1-4372-b516-1afa6e0ad1bb to /dev/vdb
Apr 14 06:05:50 user nova-compute[71312]: DEBUG os_brick.utils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:05:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc3315-b88d-47cb-8c67-13290f205610]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16005d7-0b77-4a22-9435-f7fbf68e79df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[126d4be6-26bd-4b3e-8a0c-bae8317eafe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc71c3-d8cc-488b-ab99-338a1532914f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:05:51 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:05:51 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8683827-f399-476f-889f-197987d01cce]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG os_brick.utils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:05:51 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating existing volume attachment record: b1c1335c-1ad3-464d-a786-57254f87035e {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for e9f3555f-72fe-416f-8264-9c20053a00b0 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452352.6045246, e9f3555f-72fe-416f-8264-9c20053a00b0 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:05:52 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] VM Resumed (Lifecycle Event)
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:05:52 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452352.6116228, e9f3555f-72fe-416f-8264-9c20053a00b0 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:05:52 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] VM Started (Lifecycle Event)
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:05:52 user nova-compute[71312]: WARNING nova.compute.manager [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state active and task_state None.
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:05:52 user nova-compute[71312]: WARNING nova.compute.manager [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state active and task_state None.
Apr 14 06:05:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIBZVqkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:05:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:05:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:05:54 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f578b3-8915-4303-b726-5bf349614294]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:05:54 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7f2c8b-29c5-4819-9218-c648dc13fa76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5] added
Apr 14 06:05:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[371cc184-8c34-403e-a88e-efa3eb5e75dc]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2461a49-1043-4e1b-b9f1-c393731db45d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JIBZVqkw {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JIBZVqkw" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c3d81a-4e15-433a-a2f3-f861dbbfb520]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JIBZVqkw'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c69f91-a313-47ae-affb-601121918a28]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ea728-056a-43c9-bfec-199b89083180]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1cc45c-86c5-4984-93e5-c7c5bf961630]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5, portal: 172.16.0.220,3260]
Apr 14 06:05:54 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5, portal: 172.16.0.220,3260] successful.
Apr 14 06:05:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db3b67f-c18a-4e0d-84f6-6a982225e83e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae763b11-d2e4-4f53-812e-d981e80817fa]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)
Apr 14 06:05:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[37676e3c-88c2-4e5d-b23e-b0af58aaeac3]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:05:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIBZVqkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:05:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:05:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmQKLkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:05:55 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:05:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:05:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23361356166643461', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361356166643461', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.410s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:05:56 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:05:56 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[246751a5-90d0-4f2f-8c20-659684eecfc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:05:56 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG nova.objects.instance [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f86e2-459a-4cba-ad73-b443d27716d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb] added
Apr 14 06:05:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:05:56 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:05:56 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:05:56 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:05:56 user nova-compute[71312]:   <serial>05b8da5c-e217-45e4-9a73-283be85b52c5</serial>
Apr 14 06:05:56 user nova-compute[71312]: </disk>
Apr 14 06:05:56 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3219d13-9cef-4af4-ba30-9d5b5e604a4e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef3263-1d1a-40ea-9802-19e20f95c375]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBmQKLkY {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBmQKLkY" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b818eee-7fe8-4c76-b2cf-01ce05f29888]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBmQKLkY'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[07366824-0ece-4cd4-bcfa-86cd4d34f2ea]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e0cb71-da1b-49d5-b002-72208e124f12]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[836dc381-4e25-4f8d-93bc-b15f5a7dc793]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260]
Apr 14 06:05:56 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260] successful.
Apr 14 06:05:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a329f99b-7d2d-4af1-8c80-aa2d44b6094f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd955920-b0fd-439e-b757-04128fa1d1af]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:05:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)
Apr 14 06:05:56 user nova-compute[71312]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:05:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d398dc-b6eb-4168-a2e0-9839b2afe9b6]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmQKLkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No VIF found with MAC fa:16:3e:ed:0c:d4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:05:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.872s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] <== connect_volume: return (1860ms) {'type': 'block', 'scsi_wwn': '23737646635383661', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737646635383661', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'flavor' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:05:57 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:05:57 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 06:05:57 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:05:57 user nova-compute[71312]:   <serial>bfc58917-7df1-4372-b516-1afa6e0ad1bb</serial>
Apr 14 06:05:57 user nova-compute[71312]: </disk>
Apr 14 06:05:57 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No VIF found with MAC fa:16:3e:54:23:84, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:05:57 user nova-compute[71312]: INFO nova.compute.manager [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Detaching volume 05b8da5c-e217-45e4-9a73-283be85b52c5
Apr 14 06:05:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.023s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:05:57 user nova-compute[71312]: INFO nova.virt.block_device [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attempting to driver detach volume 05b8da5c-e217-45e4-9a73-283be85b52c5 from mountpoint /dev/vdb
Apr 14 06:05:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Attempting to detach device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:05:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:05:57 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:05:57 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:05:57 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:05:57 user nova-compute[71312]:   <serial>05b8da5c-e217-45e4-9a73-283be85b52c5</serial>
Apr 14 06:05:57 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:05:57 user nova-compute[71312]: </disk>
Apr 14 06:05:57 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:05:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully detached device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the persistent domain config.
Apr 14 06:05:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:05:58 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:05:58 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:05:58 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:05:58 user nova-compute[71312]:   <serial>05b8da5c-e217-45e4-9a73-283be85b52c5</serial>
Apr 14 06:05:58 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:05:58 user nova-compute[71312]: </disk>
Apr 14 06:05:58 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452358.4144793, 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:05:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully detached device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the live domain config.
Apr 14 06:05:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIBZVqkw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:05:58 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292e5b4-1a00-4ed2-9738-7f7a04a626f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:05:58 user nova-compute[71312]: No targets found.
Apr 14 06:05:58 user nova-compute[71312]: iSNS:
Apr 14 06:05:58 user nova-compute[71312]: No targets found.
Apr 14 06:05:58 user nova-compute[71312]: STATIC:
Apr 14 06:05:58 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:05:58 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:05:58 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:05:58 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:05:58 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:05:58 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:05:58 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5
Apr 14 06:05:58 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:05:58 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:05:58 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb
Apr 14 06:05:58 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:05:58 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:05:58 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:05:58 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:05:58 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:05:58 user nova-compute[71312]: FIRMWARE:
Apr 14 06:05:58 user nova-compute[71312]: No targets found.
Apr 14 06:05:58 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:05:58 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:05:58 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1bbd41-fc02-4a73-ab7f-8add2684d57b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fdc3d9-26e9-4089-9967-4a9c04650a03]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:58 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:58 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:58 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)
Apr 14 06:05:58 user nova-compute[71312]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:05:58 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:05:58 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:05:58 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:05:58 user nova-compute[71312]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 (non-flash)
Apr 14 06:05:58 user nova-compute[71312]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:05:58 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c4131bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2067d1e0-fb2a-433a-86dd-8f3494444610]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf638d9-3960-4306-b3f3-13e28b3df00c]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c296883-c4f0-473e-8a6f-58243a4995f6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b92d6b8-55d8-4d26-86fa-f9cff4116391]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa740794-3433-42e0-910b-23e666edaccf]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.205s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a22f8-f0a9-4eba-9904-b8997f463028]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5, portal: 172.16.0.220,3260]
Apr 14 06:05:58 user nova-compute[71312]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5, portal: 172.16.0.220,3260] successful.
Apr 14 06:05:58 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05b8da5c-e217-45e4-9a73-283be85b52c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[84491dec-9741-4f30-8eee-c62c7449297c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.471s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== disconnect_volume: return (473ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:05:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:05:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:05:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.985s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:06:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing instance network info cache due to event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:06:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] Acquiring lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:06:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] Acquired lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:06:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:06:04 user nova-compute[71312]: DEBUG nova.network.neutron [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updated VIF entry in instance network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:06:04 user nova-compute[71312]: DEBUG nova.network.neutron [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:06:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] Releasing lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:06:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:06:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing instance network info cache due to event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:06:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] Acquiring lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:06:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] Acquired lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:06:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:06:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updated VIF entry in instance network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:06:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:06:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] Releasing lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:06:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:09 user nova-compute[71312]: INFO nova.compute.manager [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Rebooting instance
Apr 14 06:06:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:06:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquired lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:06:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Releasing lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-unplugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] No waiting events found dispatching network-vif-unplugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:06:10 user nova-compute[71312]: WARNING nova.compute.manager [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received unexpected event network-vif-unplugged-5803dbac-c755-47eb-93a1-ff9e122638f9 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 06:06:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance destroyed successfully.
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'resources' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-330157663',display_name='tempest-TestMinimumBasicScenario-server-330157663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-330157663',id=33,image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVDVuZxgP6T2IopyVcHDdZNThJjwKeMuN8DramwlrXcrn8VCbcLqHqBE3vvw1uInUsIuqdv/74zpirpbQBeAoaIJz1NWGtyXXGiI15gus+WidHndaCvrtXHIBgSchsOXQ==',key_name='tempest-TestMinimumBasicScenario-231549131',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-uy649w3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:06:10Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=03f4b70b-c32e-422c-856a-2edb0656df4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_vif [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5803dbac-c7, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:06:11 user nova-compute[71312]: INFO os_vif [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7')
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmQKLkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:06:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[260f186f-3163-40b4-bd1f-b12214668856]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:06:11 user nova-compute[71312]: No targets found.
Apr 14 06:06:11 user nova-compute[71312]: iSNS:
Apr 14 06:06:11 user nova-compute[71312]: No targets found.
Apr 14 06:06:11 user nova-compute[71312]: STATIC:
Apr 14 06:06:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:06:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:06:11 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:06:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:06:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:06:11 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:06:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb
Apr 14 06:06:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:06:11 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:06:11 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:06:11 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:06:11 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:06:11 user nova-compute[71312]: FIRMWARE:
Apr 14 06:06:11 user nova-compute[71312]: No targets found.
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:06:11 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:06:11 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54c188e-b085-4735-8883-2ffb94c6ef16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffa7ad0-1829-41a7-b045-36cc9504a23c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea255e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8046f49-8734-4c77-9a3c-80f7d4544a13]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e71ca0c-ac06-41b5-9cad-314ddda1b570]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e872fb3-ce11-4f0b-be2d-137085043cca]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35395267-b75d-4e74-bf43-405d734a6918]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[175dc52f-1994-4287-b077-b0d23e11b75e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991a3d4-4b04-4890-8731-8cac85fc6fd3]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260]
Apr 14 06:06:11 user nova-compute[71312]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260] successful.
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[09594f8b-5a33-427d-a952-8bad16ce9f82]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] <== disconnect_volume: return (324ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Start _get_guest_xml network_info=[{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=860c1218-de7d-4a5c-9ad4-d8cc754d539e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '860c1218-de7d-4a5c-9ad4-d8cc754d539e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'b1c1335c-1ad3-464d-a786-57254f87035e', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmQKLkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '03f4b70b-c32e-422c-856a-2edb0656df4b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfc58917-7df1-4372-b516-1afa6e0ad1bb', 'serial': 'bfc58917-7df1-4372-b516-1afa6e0ad1bb'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:06:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:06:11 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=860c1218-de7d-4a5c-9ad4-d8cc754d539e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmQKLkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:06:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:06:11 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:06:11 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[33948528-10f0-4b00-a3a9-f10dd3265473]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:06:11 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d3300d-5d43-4319-b5a3-a485b2690fbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb] added
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05b64b2-7f8e-40f9-966b-c97df34ee7ab]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e8e6ff-7d5c-45ff-821d-597d97cc8c80]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBmQKLkY {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBmQKLkY" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[42497248-00a5-479f-bdf2-804af5b0a7d5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBmQKLkY'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d7849-21db-4cc9-9d18-ded32a177e1d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcc8179-863c-4644-884f-78549a125b0d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f0e597-97ef-4d91-9d5c-7918e5978300]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260]
Apr 14 06:06:11 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260] successful.
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c90a3-6ea2-4690-b8d5-03943095c57c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec19fcd3-5508-42e8-9767-3d54250a053a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:11 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:06:11 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb7d27a-a147-4cd8-bd44-4c0ee5ee9351]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:06:11 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmQKLkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] No waiting events found dispatching network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:06:12 user nova-compute[71312]: WARNING nova.compute.manager [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received unexpected event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 06:06:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23737646635383661', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737646635383661', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-330157663',display_name='tempest-TestMinimumBasicScenario-server-330157663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-330157663',id=33,image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVDVuZxgP6T2IopyVcHDdZNThJjwKeMuN8DramwlrXcrn8VCbcLqHqBE3vvw1uInUsIuqdv/74zpirpbQBeAoaIJz1NWGtyXXGiI15gus+WidHndaCvrtXHIBgSchsOXQ==',key_name='tempest-TestMinimumBasicScenario-231549131',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-uy649w3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:06:10Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=03f4b70b-c32e-422c-856a-2edb0656df4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:06:12 user nova-compute[71312]:   <uuid>03f4b70b-c32e-422c-856a-2edb0656df4b</uuid>
Apr 14 06:06:12 user nova-compute[71312]:   <name>instance-00000021</name>
Apr 14 06:06:12 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:06:12 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:06:12 user nova-compute[71312]:   <metadata>
Apr 14 06:06:12 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:06:12 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:06:12 user nova-compute[71312]:       <nova:name>tempest-TestMinimumBasicScenario-server-330157663</nova:name>
Apr 14 06:06:12 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:06:11</nova:creationTime>
Apr 14 06:06:12 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:06:12 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:06:12 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:06:12 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:06:12 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:06:12 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:06:12 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:06:12 user nova-compute[71312]:       <nova:owner>
Apr 14 06:06:12 user nova-compute[71312]:         <nova:user uuid="b59b8f9b395149c7a2eef067766f0935">tempest-TestMinimumBasicScenario-17585386-project-member</nova:user>
Apr 14 06:06:12 user nova-compute[71312]:         <nova:project uuid="7a4e84122c3c4cb68c55043fd3c4db35">tempest-TestMinimumBasicScenario-17585386</nova:project>
Apr 14 06:06:12 user nova-compute[71312]:       </nova:owner>
Apr 14 06:06:12 user nova-compute[71312]:       <nova:root type="image" uuid="860c1218-de7d-4a5c-9ad4-d8cc754d539e"/>
Apr 14 06:06:12 user nova-compute[71312]:       <nova:ports>
Apr 14 06:06:12 user nova-compute[71312]:         <nova:port uuid="5803dbac-c755-47eb-93a1-ff9e122638f9">
Apr 14 06:06:12 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 06:06:12 user nova-compute[71312]:         </nova:port>
Apr 14 06:06:12 user nova-compute[71312]:       </nova:ports>
Apr 14 06:06:12 user nova-compute[71312]:     </nova:instance>
Apr 14 06:06:12 user nova-compute[71312]:   </metadata>
Apr 14 06:06:12 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:06:12 user nova-compute[71312]:     <system>
Apr 14 06:06:12 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:06:12 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:06:12 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:06:12 user nova-compute[71312]:       <entry name="serial">03f4b70b-c32e-422c-856a-2edb0656df4b</entry>
Apr 14 06:06:12 user nova-compute[71312]:       <entry name="uuid">03f4b70b-c32e-422c-856a-2edb0656df4b</entry>
Apr 14 06:06:12 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:06:12 user nova-compute[71312]:     </system>
Apr 14 06:06:12 user nova-compute[71312]:   </sysinfo>
Apr 14 06:06:12 user nova-compute[71312]:   <os>
Apr 14 06:06:12 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:06:12 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:06:12 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:06:12 user nova-compute[71312]:   </os>
Apr 14 06:06:12 user nova-compute[71312]:   <features>
Apr 14 06:06:12 user nova-compute[71312]:     <acpi/>
Apr 14 06:06:12 user nova-compute[71312]:     <apic/>
Apr 14 06:06:12 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:06:12 user nova-compute[71312]:   </features>
Apr 14 06:06:12 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:06:12 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:06:12 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:06:12 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:06:12 user nova-compute[71312]:   </clock>
Apr 14 06:06:12 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:06:12 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:06:12 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:06:12 user nova-compute[71312]:   </cpu>
Apr 14 06:06:12 user nova-compute[71312]:   <devices>
Apr 14 06:06:12 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:06:12 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:06:12 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk"/>
Apr 14 06:06:12 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:06:12 user nova-compute[71312]:     </disk>
Apr 14 06:06:12 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:06:12 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:06:12 user nova-compute[71312]:       <source dev="/dev/sdd"/>
Apr 14 06:06:12 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 06:06:12 user nova-compute[71312]:       <serial>bfc58917-7df1-4372-b516-1afa6e0ad1bb</serial>
Apr 14 06:06:12 user nova-compute[71312]:     </disk>
Apr 14 06:06:12 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:06:12 user nova-compute[71312]:       <mac address="fa:16:3e:54:23:84"/>
Apr 14 06:06:12 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:06:12 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:06:12 user nova-compute[71312]:       <target dev="tap5803dbac-c7"/>
Apr 14 06:06:12 user nova-compute[71312]:     </interface>
Apr 14 06:06:12 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:06:12 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/console.log" append="off"/>
Apr 14 06:06:12 user nova-compute[71312]:     </serial>
Apr 14 06:06:12 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:06:12 user nova-compute[71312]:     <video>
Apr 14 06:06:12 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:06:12 user nova-compute[71312]:     </video>
Apr 14 06:06:12 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:06:12 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:06:12 user nova-compute[71312]:     </rng>
Apr 14 06:06:12 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:06:12 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:06:12 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:06:12 user nova-compute[71312]:     </memballoon>
Apr 14 06:06:12 user nova-compute[71312]:   </devices>
Apr 14 06:06:12 user nova-compute[71312]: </domain>
Apr 14 06:06:12 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'trusted_certs' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Cannot resize image /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'migration_context' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-330157663',display_name='tempest-TestMinimumBasicScenario-server-330157663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-330157663',id=33,image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVDVuZxgP6T2IopyVcHDdZNThJjwKeMuN8DramwlrXcrn8VCbcLqHqBE3vvw1uInUsIuqdv/74zpirpbQBeAoaIJz1NWGtyXXGiI15gus+WidHndaCvrtXHIBgSchsOXQ==',key_name='tempest-TestMinimumBasicScenario-231549131',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-uy649w3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:06:10Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=03f4b70b-c32e-422c-856a-2edb0656df4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG os_vif [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5803dbac-c7, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5803dbac-c7, col_values=(('external_ids', {'iface-id': '5803dbac-c755-47eb-93a1-ff9e122638f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:23:84', 'vm-uuid': '03f4b70b-c32e-422c-856a-2edb0656df4b'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:06:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:13 user nova-compute[71312]: INFO os_vif [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7')
Apr 14 06:06:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:06:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:15 user nova-compute[71312]: DEBUG nova.compute.manager [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] No waiting events found dispatching network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:06:15 user nova-compute[71312]: WARNING nova.compute.manager [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received unexpected event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 06:06:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 03f4b70b-c32e-422c-856a-2edb0656df4b due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452376.9527457, 03f4b70b-c32e-422c-856a-2edb0656df4b => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:06:16 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] VM Resumed (Lifecycle Event)
Apr 14 06:06:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:06:16 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance rebooted successfully.
Apr 14 06:06:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:06:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:06:17 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 06:06:17 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452376.959886, 03f4b70b-c32e-422c-856a-2edb0656df4b => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:06:17 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] VM Started (Lifecycle Event)
Apr 14 06:06:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.534s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] No waiting events found dispatching network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:06:17 user nova-compute[71312]: WARNING nova.compute.manager [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received unexpected event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 for instance with vm_state active and task_state None.
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:06:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8031MB free_disk=25.947181701660156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance e9f3555f-72fe-416f-8264-9c20053a00b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 03f4b70b-c32e-422c-856a-2edb0656df4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:06:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:06:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:06:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:06:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:06:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:06:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Updating instance_info_cache with network_info: [{"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:06:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-909d40f9-ca97-4a34-bd3e-f9c98b27a963" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:06:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:06:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:06:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:06:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:06:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:06:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:06:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:06:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:06:52 user nova-compute[71312]: INFO nova.compute.manager [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attaching volume 7c8fdf2b-ea2a-4577-b25c-831bdd32a848 to /dev/vdb
Apr 14 06:06:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG os_brick.utils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8252dea8-3cb1-4d92-861e-f3641ec91cf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2d1d7-cd7d-4d9e-aac0-1d79d713bf71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fa876-0acf-4af5-bc28-ce5f23256ddb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ad2297-28a7-413a-bdc3-6474accdae9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:06:52 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:06:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5e7b80-e212-4713-9642-a838066f8143]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG os_brick.utils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:06:52 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating existing volume attachment record: 2fe4b4e9-a8b9-4f21-abdb-f30ff32aae13 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:06:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWvSHIJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:06:56 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:06:56 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:06:56 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ccd85e-d1f1-4ea5-99ee-5396c45648b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:06:56 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2daf494-c0f7-4fc3-b26e-f0d1b89a4014]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848] added
Apr 14 06:06:56 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dad12b-68bc-4685-8dfd-be21a405c883]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[611d5103-455f-450b-8845-ef1d294ed060]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWvSHIJx {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWvSHIJx" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9396291-8ef1-405e-8174-31a78d9e6211]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DWvSHIJx'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac17c7d-cd11-4fd2-b1e4-59f6c3437409]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:56 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ef0b8-c09b-4c53-8025-5c8a53e93be8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:06:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:06:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dda385-5f01-45f6-997a-48f3d477909d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848, portal: 172.16.0.220,3260]
Apr 14 06:06:57 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848, portal: 172.16.0.220,3260] successful.
Apr 14 06:06:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0424e7b-c413-4cda-8b39-ef0e52ebb12d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8551eb47-95e0-402a-9c3f-fcdb94d1ffcd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:06:57 user nova-compute[71312]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 (non-flash)
Apr 14 06:06:57 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36e925c-38fa-4871-8def-5967076734fd]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWvSHIJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:06:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23231323832343436', 'path': '/dev/sdf'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231323832343436', 'path': '/dev/sdf'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:06:58 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:06:58 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 06:06:58 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:06:58 user nova-compute[71312]:   <serial>7c8fdf2b-ea2a-4577-b25c-831bdd32a848</serial>
Apr 14 06:06:58 user nova-compute[71312]: </disk>
Apr 14 06:06:58 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No VIF found with MAC fa:16:3e:ed:0c:d4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:06:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.512s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:00 user nova-compute[71312]: INFO nova.compute.manager [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Detaching volume 7c8fdf2b-ea2a-4577-b25c-831bdd32a848
Apr 14 06:07:00 user nova-compute[71312]: INFO nova.virt.block_device [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attempting to driver detach volume 7c8fdf2b-ea2a-4577-b25c-831bdd32a848 from mountpoint /dev/vdb
Apr 14 06:07:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Attempting to detach device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:07:00 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:07:00 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 06:07:00 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:07:00 user nova-compute[71312]:   <serial>7c8fdf2b-ea2a-4577-b25c-831bdd32a848</serial>
Apr 14 06:07:00 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:07:00 user nova-compute[71312]: </disk>
Apr 14 06:07:00 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:07:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully detached device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the persistent domain config.
Apr 14 06:07:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:07:00 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:07:00 user nova-compute[71312]:   <source dev="/dev/sdf"/>
Apr 14 06:07:00 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:07:00 user nova-compute[71312]:   <serial>7c8fdf2b-ea2a-4577-b25c-831bdd32a848</serial>
Apr 14 06:07:00 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:07:00 user nova-compute[71312]: </disk>
Apr 14 06:07:00 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452420.837264, 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:07:00 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully detached device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the live domain config.
Apr 14 06:07:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWvSHIJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:07:00 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee9a41c-9cdb-4687-980e-2632b99a4880]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:07:00 user nova-compute[71312]: No targets found.
Apr 14 06:07:00 user nova-compute[71312]: iSNS:
Apr 14 06:07:00 user nova-compute[71312]: No targets found.
Apr 14 06:07:00 user nova-compute[71312]: STATIC:
Apr 14 06:07:00 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:07:00 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:00 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:00 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:07:00 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:00 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:00 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848
Apr 14 06:07:00 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:00 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:00 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb
Apr 14 06:07:00 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:00 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:00 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:07:00 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:00 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:00 user nova-compute[71312]: FIRMWARE:
Apr 14 06:07:00 user nova-compute[71312]: No targets found.
Apr 14 06:07:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:07:00 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:07:00 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e60a2e7-6163-4a68-a8cf-b1f28de235bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b3eea5-ea50-492d-b893-48caba9e0a72]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:00 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:07:00 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:07:00 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:00 user nova-compute[71312]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 (non-flash)
Apr 14 06:07:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:00 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:07:00 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:07:00 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:00 user nova-compute[71312]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 (non-flash)
Apr 14 06:07:00 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c41f9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848'): ({'sdf'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Removing single pathed devices sdf {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d3a263-ace2-42b3-bfc7-93fe6801d106]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d103a6c6-bfbe-4e4f-8932-f3178a985384]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Flushing IO for device /dev/sdf {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b82a0a7-472b-4d62-bf9f-b25963f2b337]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:07:00 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b74e924-e094-4460-8acf-f8753a5d90df]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] SCSI volumes sdf have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aa42aa-38a8-45e6-bba6-ea854291522a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a580e1-b63d-4085-acf8-9bb7e597901f]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848, portal: 172.16.0.220,3260]
Apr 14 06:07:01 user nova-compute[71312]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848, portal: 172.16.0.220,3260] successful.
Apr 14 06:07:01 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8fdf2b-ea2a-4577-b25c-831bdd32a848 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd58b651-8c2a-4897-b880-0fc9d9ab608b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== disconnect_volume: return (308ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG nova.objects.instance [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:07:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:09 user nova-compute[71312]: INFO nova.compute.manager [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Terminating instance
Apr 14 06:07:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-unplugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Instance destroyed successfully.
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'resources' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T05:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-493161134',display_name='tempest-ServerActionsTestJSON-server-1862725483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-493161134',id=21,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:04:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-2dlrcm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=4e8ac55a-5fe7-470b-b04e-97a9f00f3187,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "address": "fa:16:3e:6e:2e:0e", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a0c510-de", "ovs_interfaceid": "98a0c510-de09-47fb-b8cc-7a053b97eb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_vif [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98a0c510-de, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:07:10 user nova-compute[71312]: INFO os_vif [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2e:0e,bridge_name='br-int',has_traffic_filtering=True,id=98a0c510-de09-47fb-b8cc-7a053b97eb82,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a0c510-de')
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEaYSAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:07:10 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f0f64-8bc6-4f42-ba23-a0bc5bcdc35b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:07:10 user nova-compute[71312]: No targets found.
Apr 14 06:07:10 user nova-compute[71312]: iSNS:
Apr 14 06:07:10 user nova-compute[71312]: No targets found.
Apr 14 06:07:10 user nova-compute[71312]: STATIC:
Apr 14 06:07:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:07:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:10 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550
Apr 14 06:07:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:10 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb
Apr 14 06:07:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:10 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:10 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:07:10 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:10 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:10 user nova-compute[71312]: FIRMWARE:
Apr 14 06:07:10 user nova-compute[71312]: No targets found.
Apr 14 06:07:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:07:10 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:07:10 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa8153e-7c87-47e0-bab9-f169b5d44714]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73f9de7-8461-40c9-b51f-003a5613c3cb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:10 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:07:10 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:07:10 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:10 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:07:10 user nova-compute[71312]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 (non-flash)
Apr 14 06:07:10 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4c23f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[95443246-1f52-462f-9cde-03d902d0d776]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b5d6ae-6667-4628-a381-e97a74dbba1b]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[25839033-549c-46d8-ae3b-f28f7dc9e4e4]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd507cd5-8073-49fe-94dc-74688fd4aada]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[93721a47-b44f-4727-9c4e-2609b4fc9b7f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eb1c1a-1335-431d-b162-3233485613c8]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260]
Apr 14 06:07:10 user nova-compute[71312]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550, portal: 172.16.0.220,3260] successful.
Apr 14 06:07:10 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1c1a968-04ba-403c-8a35-91dd18d10550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a4509f-4ef5-4034-9b7b-6f4925e4d67c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== disconnect_volume: return (346ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:07:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:07:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Deleting instance files /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187_del
Apr 14 06:07:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Deletion of /opt/stack/data/nova/instances/4e8ac55a-5fe7-470b-b04e-97a9f00f3187_del complete
Apr 14 06:07:11 user nova-compute[71312]: INFO nova.compute.manager [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Took 1.29 seconds to destroy the instance on the hypervisor.
Apr 14 06:07:11 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:07:11 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:07:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:07:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:07:11 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Took 0.75 seconds to deallocate network for instance.
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Acquiring lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] No waiting events found dispatching network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:07:12 user nova-compute[71312]: WARNING nova.compute.manager [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received unexpected event network-vif-plugged-98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance with vm_state active and task_state deleting.
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Received event network-vif-deleted-98a0c510-de09-47fb-b8cc-7a053b97eb82 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:12 user nova-compute[71312]: INFO nova.compute.manager [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Terminating instance
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:12 user nova-compute[71312]: INFO nova.compute.manager [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:07:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Instance destroyed successfully.
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lazy-loading 'resources' on Instance uuid 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1512759437',display_name='tempest-VolumesNegativeTest-instance-1512759437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1512759437',id=34,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:05:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2da761d3e4e148b592b6edda8197ce00',ramdisk_id='',reservation_id='r-74rqox9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-678118524',owner_user_name='tempest-VolumesNegativeTest-678118524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:05:29Z,user_data=None,user_id='a6991107308f4db89290f32efd2ac63e',uuid=6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Converting VIF {"id": "85a2a34f-7864-4659-90be-ecf0c970ce09", "address": "fa:16:3e:39:5a:ee", "network": {"id": "46f20229-cdf5-455d-abb1-1307e0429802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0a2da75cb0e40419466981ce2fc0eb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a2a34f-78", "ovs_interfaceid": "85a2a34f-7864-4659-90be-ecf0c970ce09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:5a:ee,bridge_name='br-int',has_traffic_filtering=True,id=85a2a34f-7864-4659-90be-ecf0c970ce09,network=Network(46f20229-cdf5-455d-abb1-1307e0429802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a2a34f-78') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG os_vif [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:5a:ee,bridge_name='br-int',has_traffic_filtering=True,id=85a2a34f-7864-4659-90be-ecf0c970ce09,network=Network(46f20229-cdf5-455d-abb1-1307e0429802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a2a34f-78') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a2a34f-78, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:07:12 user nova-compute[71312]: INFO os_vif [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:5a:ee,bridge_name='br-int',has_traffic_filtering=True,id=85a2a34f-7864-4659-90be-ecf0c970ce09,network=Network(46f20229-cdf5-455d-abb1-1307e0429802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a2a34f-78')
Apr 14 06:07:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Deleting instance files /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf_del
Apr 14 06:07:12 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Deletion of /opt/stack/data/nova/instances/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf_del complete
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:12 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Deleted allocations for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187
Apr 14 06:07:12 user nova-compute[71312]: INFO nova.compute.manager [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 06:07:12 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:07:12 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "4e8ac55a-5fe7-470b-b04e-97a9f00f3187" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.315s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:13 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:07:13 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Took 0.44 seconds to deallocate network for instance.
Apr 14 06:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:13 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:07:13 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:13 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Deleted allocations for instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf
Apr 14 06:07:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.549s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received event network-vif-unplugged-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Acquiring lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] No waiting events found dispatching network-vif-unplugged-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:07:14 user nova-compute[71312]: WARNING nova.compute.manager [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received unexpected event network-vif-unplugged-85a2a34f-7864-4659-90be-ecf0c970ce09 for instance with vm_state deleted and task_state None.
Apr 14 06:07:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received event network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Acquiring lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Lock "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] No waiting events found dispatching network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:07:14 user nova-compute[71312]: WARNING nova.compute.manager [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received unexpected event network-vif-plugged-85a2a34f-7864-4659-90be-ecf0c970ce09 for instance with vm_state deleted and task_state None.
Apr 14 06:07:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Received event network-vif-deleted-85a2a34f-7864-4659-90be-ecf0c970ce09 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:18 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:07:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:07:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:20 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:07:20 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8170MB free_disk=25.985076904296875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance e9f3555f-72fe-416f-8264-9c20053a00b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 03f4b70b-c32e-422c-856a-2edb0656df4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:07:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:07:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:07:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:07:25 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452430.4864552, 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:07:25 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] VM Stopped (Lifecycle Event)
Apr 14 06:07:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-925f080a-fd4d-47a4-8782-050eebb97a97 None None] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:07:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:07:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:07:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:07:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:07:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updating instance_info_cache with network_info: [{"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:07:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-e9f3555f-72fe-416f-8264-9c20053a00b0" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:07:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:07:27 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452432.8957233, 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:07:27 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] VM Stopped (Lifecycle Event)
Apr 14 06:07:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3cb40bca-44fe-47e4-8c77-6d199f8888d5 None None] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:07:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:07:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:07:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:07:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:07:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:38 user nova-compute[71312]: INFO nova.compute.manager [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Terminating instance
Apr 14 06:07:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:07:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-unplugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Instance destroyed successfully.
Apr 14 06:07:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'resources' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:02:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1234839153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1234839153',id=31,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-x3n5xvoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:05:53Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=e9f3555f-72fe-416f-8264-9c20053a00b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "075d60ed-d208-452b-a993-da51fb4bfd77", "address": "fa:16:3e:f6:8e:b3", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075d60ed-d2", "ovs_interfaceid": "075d60ed-d208-452b-a993-da51fb4bfd77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:8e:b3,bridge_name='br-int',has_traffic_filtering=True,id=075d60ed-d208-452b-a993-da51fb4bfd77,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075d60ed-d2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_vif [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:8e:b3,bridge_name='br-int',has_traffic_filtering=True,id=075d60ed-d208-452b-a993-da51fb4bfd77,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075d60ed-d2') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap075d60ed-d2, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:07:39 user nova-compute[71312]: INFO os_vif [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:8e:b3,bridge_name='br-int',has_traffic_filtering=True,id=075d60ed-d208-452b-a993-da51fb4bfd77,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075d60ed-d2')
Apr 14 06:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYGVoqOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:07:39 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aae305c-4493-4ad7-b3ab-a25fff53c073]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:07:39 user nova-compute[71312]: No targets found.
Apr 14 06:07:39 user nova-compute[71312]: iSNS:
Apr 14 06:07:39 user nova-compute[71312]: No targets found.
Apr 14 06:07:39 user nova-compute[71312]: STATIC:
Apr 14 06:07:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6
Apr 14 06:07:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:39 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb
Apr 14 06:07:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:39 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:39 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:07:39 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:07:39 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:07:39 user nova-compute[71312]: FIRMWARE:
Apr 14 06:07:39 user nova-compute[71312]: No targets found.
Apr 14 06:07:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:07:39 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:07:39 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e55d82-5495-4ac1-9bf8-5ec6e362a0cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0d0de1-fbd9-4214-ab56-a95f37699e12]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:39 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:07:39 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:39 user nova-compute[71312]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 (non-flash)
Apr 14 06:07:39 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c41f9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd5cc49-58e6-43ae-8a87-6819e7404dae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c6d548-bf41-4869-81a4-7fce2fa4f7ea]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f84bb8-e271-495c-957a-608c7609c6f6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55234f9-3c15-46d4-8058-af039e62fd9b]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO620e0823-5c0bb908ad4fd4bd', '/dev/disk/by-id/scsi-23563306262393038', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_620e0823') {{(pid=81359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ad5935-b22e-42fd-aa20-a8fffd917829]: (4, None) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[824834e9-39a9-4961-addc-4adac95f1b1d]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d483638-454f-4299-93b0-1fc68f82ee0c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6, portal: 172.16.0.220,3260]
Apr 14 06:07:39 user nova-compute[71312]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6, portal: 172.16.0.220,3260] successful.
Apr 14 06:07:39 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9467f270-f43f-4a6e-86ba-fe82db2ec0c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ba95e-e21c-413d-8760-b61a23804302]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] <== disconnect_volume: return (303ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:07:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Deleting instance files /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0_del
Apr 14 06:07:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Deletion of /opt/stack/data/nova/instances/e9f3555f-72fe-416f-8264-9c20053a00b0_del complete
Apr 14 06:07:39 user nova-compute[71312]: INFO nova.compute.manager [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 06:07:39 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:07:39 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:07:40 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:07:40 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Took 0.50 seconds to deallocate network for instance.
Apr 14 06:07:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Acquiring lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] No waiting events found dispatching network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:07:41 user nova-compute[71312]: WARNING nova.compute.manager [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received unexpected event network-vif-plugged-075d60ed-d208-452b-a993-da51fb4bfd77 for instance with vm_state active and task_state deleting.
Apr 14 06:07:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Received event network-vif-deleted-075d60ed-d208-452b-a993-da51fb4bfd77 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:07:41 user nova-compute[71312]: INFO nova.compute.manager [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Took 0.83 seconds to detach 1 volumes for instance.
Apr 14 06:07:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:41 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:07:41 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:07:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:41 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Deleted allocations for instance e9f3555f-72fe-416f-8264-9c20053a00b0
Apr 14 06:07:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "e9f3555f-72fe-416f-8264-9c20053a00b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.926s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452459.4301152, e9f3555f-72fe-416f-8264-9c20053a00b0 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:07:54 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] VM Stopped (Lifecycle Event)
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-594110b2-e540-4195-ad9d-a1c205fbde0c None None] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG nova.objects.instance [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:07:54 user nova-compute[71312]: INFO nova.compute.manager [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attaching volume 54d090c3-2714-4bf5-9b41-58a1b7420b84 to /dev/vdb
Apr 14 06:07:54 user nova-compute[71312]: DEBUG os_brick.utils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe5ac14-b610-4ac1-9fce-a6c7c551c0d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca84570-ce57-426c-b7db-c1aba4f28578]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9e8e21-ae52-4064-8b13-cb8046264e9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a414a386-b6dc-4fb4-9abd-05c838eebe44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:07:54 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:07:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51506db-4763-460d-98b7-38fdea466bc6]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG os_brick.utils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:07:54 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating existing volume attachment record: 2792c19c-ffe9-478d-9e9a-5da21c200a85 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:07:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCySduoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:07:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:07:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:07:59 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8289756d-4b67-4d07-b1d8-86d942be66e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:07:59 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a17eb-6e47-41ec-9911-534af8905cdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84] added
Apr 14 06:07:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b907759d-2a99-41f4-8791-d0d1fa3bd08c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7235e2-e972-4f84-af26-6ce446f3f117]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCySduoE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCySduoE" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[562a47a1-0c8b-4ffe-b34b-64de53735001]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCySduoE'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e4fb7-804f-4791-ac2b-c188bcdff1b9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c18c5-ebe6-4e24-bc18-91db8a97f850]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:59 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:59 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c775289-a4e0-489c-a4d4-188a13606bb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84, portal: 172.16.0.220,3260]
Apr 14 06:07:59 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84, portal: 172.16.0.220,3260] successful.
Apr 14 06:07:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a46d36-4d5b-4820-801d-2f349bf94562]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa13fc7-d1d5-4889-a9ec-17d8362c2fac]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:59 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:59 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)
Apr 14 06:07:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:07:59 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:07:59 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)
Apr 14 06:07:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[041bff5e-1926-4250-ac7c-e71548c26786]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:07:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCySduoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26365663535313265', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365663535313265', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:08:00 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:08:00 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:08:00 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:08:00 user nova-compute[71312]:   <serial>54d090c3-2714-4bf5-9b41-58a1b7420b84</serial>
Apr 14 06:08:00 user nova-compute[71312]: </disk>
Apr 14 06:08:00 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing instance network info cache due to event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] Acquiring lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] Acquired lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:08:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] No VIF found with MAC fa:16:3e:ed:0c:d4, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.517s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updated VIF entry in instance network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] Releasing lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:08:01 user nova-compute[71312]: INFO nova.compute.claims [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Claim successful on node user
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing instance network info cache due to event network-changed-5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] Acquiring lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] Acquired lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.network.neutron [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Refreshing network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.network.neutron [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:08:01 user nova-compute[71312]: INFO nova.compute.manager [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Detaching volume bfc58917-7df1-4372-b516-1afa6e0ad1bb
Apr 14 06:08:01 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:08:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:08:02 user nova-compute[71312]: INFO nova.virt.block_device [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Attempting to driver detach volume bfc58917-7df1-4372-b516-1afa6e0ad1bb from mountpoint /dev/vdb
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Attempting to detach device vdb from instance 03f4b70b-c32e-422c-856a-2edb0656df4b from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:08:02 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:08:02 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:08:02 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:08:02 user nova-compute[71312]:   <serial>bfc58917-7df1-4372-b516-1afa6e0ad1bb</serial>
Apr 14 06:08:02 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 06:08:02 user nova-compute[71312]: </disk>
Apr 14 06:08:02 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:08:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully detached device vdb from instance 03f4b70b-c32e-422c-856a-2edb0656df4b from the persistent domain config.
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03f4b70b-c32e-422c-856a-2edb0656df4b from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:08:02 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:08:02 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:08:02 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:08:02 user nova-compute[71312]:   <serial>bfc58917-7df1-4372-b516-1afa6e0ad1bb</serial>
Apr 14 06:08:02 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 06:08:02 user nova-compute[71312]: </disk>
Apr 14 06:08:02 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:08:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Creating image(s)
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "/opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "/opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "/opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.policy [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk 1073741824" returned: 0 in 0.049s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452482.511606, 03f4b70b-c32e-422c-856a-2edb0656df4b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:08:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully detached device vdb from instance 03f4b70b-c32e-422c-856a-2edb0656df4b from the live domain config.
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmQKLkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:08:02 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47d7dad-2a1e-4943-9e20-200c75792c5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:08:02 user nova-compute[71312]: No targets found.
Apr 14 06:08:02 user nova-compute[71312]: iSNS:
Apr 14 06:08:02 user nova-compute[71312]: No targets found.
Apr 14 06:08:02 user nova-compute[71312]: STATIC:
Apr 14 06:08:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84
Apr 14 06:08:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:08:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:08:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb
Apr 14 06:08:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:08:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:08:02 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:08:02 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:08:02 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:08:02 user nova-compute[71312]: FIRMWARE:
Apr 14 06:08:02 user nova-compute[71312]: No targets found.
Apr 14 06:08:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:08:02 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:08:02 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6fd890-4013-4803-9329-142d984b9707]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d4fb9b-ad3c-454a-b75a-a68a583fa0e6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:08:02 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:08:02 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)
Apr 14 06:08:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:08:02 user nova-compute[71312]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb (non-flash)
Apr 14 06:08:02 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)
Apr 14 06:08:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea3d3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f66e61-afca-4b27-8551-f78256a72139]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a9f2ae-7735-4d4a-b5bd-fa6657046f62]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb9c43-361e-4a25-8e3f-ac268d5f0155]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Cannot resize image /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.objects.instance [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'migration_context' on Instance uuid 594c89a2-66e3-4d1d-8331-60a6aa03c66c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4f82f0-0713-4c21-8457-b3e5b1c83faf]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Ensure instance console log exists: /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b4a51-0f4c-4217-a2c1-ba82b29fdcc1]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.network.neutron [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Successfully created port: 1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7fcbbd-1b71-4fec-983a-d00bb30cec50]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260]
Apr 14 06:08:02 user nova-compute[71312]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb, portal: 172.16.0.220,3260] successful.
Apr 14 06:08:02 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc58917-7df1-4372-b516-1afa6e0ad1bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cf0a94-9c9d-4066-9a6d-23d0f60dad61]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] <== disconnect_volume: return (369ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:02 user nova-compute[71312]: INFO nova.compute.manager [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Detaching volume 54d090c3-2714-4bf5-9b41-58a1b7420b84
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.network.neutron [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updated VIF entry in instance network info cache for port 5803dbac-c755-47eb-93a1-ff9e122638f9. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG nova.network.neutron [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [{"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:08:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] Releasing lock "refresh_cache-03f4b70b-c32e-422c-856a-2edb0656df4b" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:08:02 user nova-compute[71312]: INFO nova.virt.block_device [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Attempting to driver detach volume 54d090c3-2714-4bf5-9b41-58a1b7420b84 from mountpoint /dev/vdb
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Attempting to detach device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:08:03 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:08:03 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:08:03 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:08:03 user nova-compute[71312]:   <serial>54d090c3-2714-4bf5-9b41-58a1b7420b84</serial>
Apr 14 06:08:03 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:08:03 user nova-compute[71312]: </disk>
Apr 14 06:08:03 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:08:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully detached device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the persistent domain config.
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:08:03 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:08:03 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:08:03 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:08:03 user nova-compute[71312]:   <serial>54d090c3-2714-4bf5-9b41-58a1b7420b84</serial>
Apr 14 06:08:03 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:08:03 user nova-compute[71312]: </disk>
Apr 14 06:08:03 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452483.4697907, 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:08:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully detached device vdb from instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 from the live domain config.
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCySduoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:08:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0378ba9e-82f8-4bb8-b5f0-be0d21c2c362]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:08:03 user nova-compute[71312]: No targets found.
Apr 14 06:08:03 user nova-compute[71312]: iSNS:
Apr 14 06:08:03 user nova-compute[71312]: No targets found.
Apr 14 06:08:03 user nova-compute[71312]: STATIC:
Apr 14 06:08:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84
Apr 14 06:08:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:08:03 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:08:03 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:08:03 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:08:03 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:08:03 user nova-compute[71312]: FIRMWARE:
Apr 14 06:08:03 user nova-compute[71312]: No targets found.
Apr 14 06:08:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:08:03 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:08:03 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa221a64-cd19-45d7-9e38-33aae350f379]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b9a4d1-195c-42d7-a384-bc30f342d7d8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:08:03 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)
Apr 14 06:08:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:08:03 user nova-compute[71312]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 (non-flash)
Apr 14 06:08:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49ea2231c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.network.neutron [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Successfully updated port: 1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fca238-48af-476f-bb02-a8aa0f293a70]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.network.neutron [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4d3a03-9639-44f2-bf2f-8adb9899f675]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-changed-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.compute.manager [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Refreshing instance network info cache due to event network-changed-1368a896-f16c-4222-9542-c591daa2e361. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] Acquiring lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f7019c-d61b-437e-9563-bbb2f7dacd62]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.network.neutron [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4174f29-de1e-4f70-9225-2163a13aca3a]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa657d-143f-4f2b-abfb-4d521e47e9a9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.objects.instance [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'flavor' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce2fa2f-8efe-4a40-b39f-98c91de3c41e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84, portal: 172.16.0.220,3260]
Apr 14 06:08:03 user nova-compute[71312]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84, portal: 172.16.0.220,3260] successful.
Apr 14 06:08:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d090c3-2714-4bf5-9b41-58a1b7420b84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ac08d-e40d-455c-ac6c-8cc46619a206]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] <== disconnect_volume: return (302ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.874s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.network.neutron [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updating instance_info_cache with network_info: [{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Instance network_info: |[{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] Acquired lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.network.neutron [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Refreshing network info cache for port 1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Start _get_guest_xml network_info=[{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:08:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:08:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:08:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1316450739',display_name='tempest-ServerActionsTestJSON-server-1316450739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1316450739',id=35,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-90hibjyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=594c89a2-66e3-4d1d-8331-60a6aa03c66c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=1368a896-f16c-4222-9542-c591daa2e361,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1368a896-f1') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_devices' on Instance uuid 594c89a2-66e3-4d1d-8331-60a6aa03c66c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:08:04 user nova-compute[71312]:   <uuid>594c89a2-66e3-4d1d-8331-60a6aa03c66c</uuid>
Apr 14 06:08:04 user nova-compute[71312]:   <name>instance-00000023</name>
Apr 14 06:08:04 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:08:04 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:08:04 user nova-compute[71312]:   <metadata>
Apr 14 06:08:04 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:08:04 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:08:04 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestJSON-server-1316450739</nova:name>
Apr 14 06:08:04 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:08:03</nova:creationTime>
Apr 14 06:08:04 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:08:04 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:08:04 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:08:04 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:08:04 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:08:04 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:08:04 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:08:04 user nova-compute[71312]:       <nova:owner>
Apr 14 06:08:04 user nova-compute[71312]:         <nova:user uuid="290b67b22a91443fbfc829fa4e3db036">tempest-ServerActionsTestJSON-31064769-project-member</nova:user>
Apr 14 06:08:04 user nova-compute[71312]:         <nova:project uuid="dbc4321a7868464faa59341018ed747f">tempest-ServerActionsTestJSON-31064769</nova:project>
Apr 14 06:08:04 user nova-compute[71312]:       </nova:owner>
Apr 14 06:08:04 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:08:04 user nova-compute[71312]:       <nova:ports>
Apr 14 06:08:04 user nova-compute[71312]:         <nova:port uuid="1368a896-f16c-4222-9542-c591daa2e361">
Apr 14 06:08:04 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 06:08:04 user nova-compute[71312]:         </nova:port>
Apr 14 06:08:04 user nova-compute[71312]:       </nova:ports>
Apr 14 06:08:04 user nova-compute[71312]:     </nova:instance>
Apr 14 06:08:04 user nova-compute[71312]:   </metadata>
Apr 14 06:08:04 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:08:04 user nova-compute[71312]:     <system>
Apr 14 06:08:04 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:08:04 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:08:04 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:08:04 user nova-compute[71312]:       <entry name="serial">594c89a2-66e3-4d1d-8331-60a6aa03c66c</entry>
Apr 14 06:08:04 user nova-compute[71312]:       <entry name="uuid">594c89a2-66e3-4d1d-8331-60a6aa03c66c</entry>
Apr 14 06:08:04 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:08:04 user nova-compute[71312]:     </system>
Apr 14 06:08:04 user nova-compute[71312]:   </sysinfo>
Apr 14 06:08:04 user nova-compute[71312]:   <os>
Apr 14 06:08:04 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:08:04 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:08:04 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:08:04 user nova-compute[71312]:   </os>
Apr 14 06:08:04 user nova-compute[71312]:   <features>
Apr 14 06:08:04 user nova-compute[71312]:     <acpi/>
Apr 14 06:08:04 user nova-compute[71312]:     <apic/>
Apr 14 06:08:04 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:08:04 user nova-compute[71312]:   </features>
Apr 14 06:08:04 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:08:04 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:08:04 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:08:04 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:08:04 user nova-compute[71312]:   </clock>
Apr 14 06:08:04 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:08:04 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:08:04 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:08:04 user nova-compute[71312]:   </cpu>
Apr 14 06:08:04 user nova-compute[71312]:   <devices>
Apr 14 06:08:04 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:08:04 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:08:04 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk"/>
Apr 14 06:08:04 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:08:04 user nova-compute[71312]:     </disk>
Apr 14 06:08:04 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:08:04 user nova-compute[71312]:       <mac address="fa:16:3e:0f:af:b5"/>
Apr 14 06:08:04 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:08:04 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:08:04 user nova-compute[71312]:       <target dev="tap1368a896-f1"/>
Apr 14 06:08:04 user nova-compute[71312]:     </interface>
Apr 14 06:08:04 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:08:04 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/console.log" append="off"/>
Apr 14 06:08:04 user nova-compute[71312]:     </serial>
Apr 14 06:08:04 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:08:04 user nova-compute[71312]:     <video>
Apr 14 06:08:04 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:08:04 user nova-compute[71312]:     </video>
Apr 14 06:08:04 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:08:04 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:08:04 user nova-compute[71312]:     </rng>
Apr 14 06:08:04 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:08:04 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:08:04 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:08:04 user nova-compute[71312]:     </memballoon>
Apr 14 06:08:04 user nova-compute[71312]:   </devices>
Apr 14 06:08:04 user nova-compute[71312]: </domain>
Apr 14 06:08:04 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1316450739',display_name='tempest-ServerActionsTestJSON-server-1316450739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1316450739',id=35,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-90hibjyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=594c89a2-66e3-4d1d-8331-60a6aa03c66c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=1368a896-f16c-4222-9542-c591daa2e361,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1368a896-f1') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG os_vif [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=1368a896-f16c-4222-9542-c591daa2e361,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1368a896-f1') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1368a896-f1, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1368a896-f1, col_values=(('external_ids', {'iface-id': '1368a896-f16c-4222-9542-c591daa2e361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:af:b5', 'vm-uuid': '594c89a2-66e3-4d1d-8331-60a6aa03c66c'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:04 user nova-compute[71312]: INFO os_vif [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=1368a896-f16c-4222-9542-c591daa2e361,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1368a896-f1')
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No VIF found with MAC fa:16:3e:0f:af:b5, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.network.neutron [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updated VIF entry in instance network info cache for port 1368a896-f16c-4222-9542-c591daa2e361. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.network.neutron [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updating instance_info_cache with network_info: [{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] Releasing lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'flavor' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:08:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] No waiting events found dispatching network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:08:05 user nova-compute[71312]: WARNING nova.compute.manager [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received unexpected event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 for instance with vm_state building and task_state spawning.
Apr 14 06:08:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452487.5210452, 594c89a2-66e3-4d1d-8331-60a6aa03c66c => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:08:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] VM Resumed (Lifecycle Event)
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:08:07 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Instance spawned successfully.
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:08:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452487.5237753, 594c89a2-66e3-4d1d-8331-60a6aa03c66c => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:08:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] VM Started (Lifecycle Event)
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:08:07 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:08:07 user nova-compute[71312]: INFO nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] No waiting events found dispatching network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:08:07 user nova-compute[71312]: WARNING nova.compute.manager [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received unexpected event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 for instance with vm_state building and task_state spawning.
Apr 14 06:08:07 user nova-compute[71312]: INFO nova.compute.manager [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Took 6.25 seconds to build instance.
Apr 14 06:08:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.345s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:18 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:08:18 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:08:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:08:20 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:08:20 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=25.981304168701172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 03f4b70b-c32e-422c-856a-2edb0656df4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:08:20 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:08:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:08:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:08:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:08:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:08:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:08:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:08:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:08:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:08:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating instance_info_cache with network_info: [{"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:08:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:08:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:08:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:29 user nova-compute[71312]: INFO nova.compute.manager [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Terminating instance
Apr 14 06:08:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received event network-vif-unplugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] Acquiring lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] No waiting events found dispatching network-vif-unplugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received event network-vif-unplugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Instance destroyed successfully.
Apr 14 06:08:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'resources' on Instance uuid 909d40f9-ca97-4a34-bd3e-f9c98b27a963 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-767513540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-767513540',id=27,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:59:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-rf6r6ia8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:01:05Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=909d40f9-ca97-4a34-bd3e-f9c98b27a963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "address": "fa:16:3e:ca:84:c2", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ba85e5-aa", "ovs_interfaceid": "b9ba85e5-aaf3-43c4-a3ed-241516556ced", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:84:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9ba85e5-aaf3-43c4-a3ed-241516556ced,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ba85e5-aa') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG os_vif [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:84:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9ba85e5-aaf3-43c4-a3ed-241516556ced,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ba85e5-aa') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9ba85e5-aa, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:08:30 user nova-compute[71312]: INFO os_vif [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:84:c2,bridge_name='br-int',has_traffic_filtering=True,id=b9ba85e5-aaf3-43c4-a3ed-241516556ced,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ba85e5-aa')
Apr 14 06:08:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Deleting instance files /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963_del
Apr 14 06:08:30 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Deletion of /opt/stack/data/nova/instances/909d40f9-ca97-4a34-bd3e-f9c98b27a963_del complete
Apr 14 06:08:30 user nova-compute[71312]: INFO nova.compute.manager [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 06:08:30 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:08:30 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:08:31 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Took 0.87 seconds to deallocate network for instance.
Apr 14 06:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:31 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Deleted allocations for instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963
Apr 14 06:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.141s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received event network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Acquiring lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Lock "909d40f9-ca97-4a34-bd3e-f9c98b27a963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] No waiting events found dispatching network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:08:31 user nova-compute[71312]: WARNING nova.compute.manager [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received unexpected event network-vif-plugged-b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance with vm_state deleted and task_state None.
Apr 14 06:08:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Received event network-vif-deleted-b9ba85e5-aaf3-43c4-a3ed-241516556ced {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:08:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:45 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452510.2081337, 909d40f9-ca97-4a34-bd3e-f9c98b27a963 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:08:45 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] VM Stopped (Lifecycle Event)
Apr 14 06:08:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-585f4a55-a917-45b5-a586-f2c0625e434c None None] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:08:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:08:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:55 user nova-compute[71312]: INFO nova.compute.manager [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Terminating instance
Apr 14 06:08:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-unplugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] No waiting events found dispatching network-vif-unplugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-unplugged-5803dbac-c755-47eb-93a1-ff9e122638f9 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Instance destroyed successfully.
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.objects.instance [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'resources' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-330157663',display_name='tempest-TestMinimumBasicScenario-server-330157663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-330157663',id=33,image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVDVuZxgP6T2IopyVcHDdZNThJjwKeMuN8DramwlrXcrn8VCbcLqHqBE3vvw1uInUsIuqdv/74zpirpbQBeAoaIJz1NWGtyXXGiI15gus+WidHndaCvrtXHIBgSchsOXQ==',key_name='tempest-TestMinimumBasicScenario-231549131',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-uy649w3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='860c1218-de7d-4a5c-9ad4-d8cc754d539e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:06:17Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=03f4b70b-c32e-422c-856a-2edb0656df4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "5803dbac-c755-47eb-93a1-ff9e122638f9", "address": "fa:16:3e:54:23:84", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5803dbac-c7", "ovs_interfaceid": "5803dbac-c755-47eb-93a1-ff9e122638f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG os_vif [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5803dbac-c7, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:08:56 user nova-compute[71312]: INFO os_vif [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:84,bridge_name='br-int',has_traffic_filtering=True,id=5803dbac-c755-47eb-93a1-ff9e122638f9,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5803dbac-c7')
Apr 14 06:08:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Deleting instance files /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b_del
Apr 14 06:08:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Deletion of /opt/stack/data/nova/instances/03f4b70b-c32e-422c-856a-2edb0656df4b_del complete
Apr 14 06:08:56 user nova-compute[71312]: INFO nova.compute.manager [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 06:08:56 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:08:56 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:08:57 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:08:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-deleted-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:57 user nova-compute[71312]: INFO nova.compute.manager [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Neutron deleted interface 5803dbac-c755-47eb-93a1-ff9e122638f9; detaching it from the instance and deleting it from the info cache
Apr 14 06:08:57 user nova-compute[71312]: DEBUG nova.network.neutron [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:08:57 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Took 0.66 seconds to deallocate network for instance.
Apr 14 06:08:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Detach interface failed, port_id=5803dbac-c755-47eb-93a1-ff9e122638f9, reason: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 06:08:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:57 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:08:57 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:08:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:57 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Deleted allocations for instance 03f4b70b-c32e-422c-856a-2edb0656df4b
Apr 14 06:08:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.962s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:08:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] Acquiring lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:08:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:08:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] Lock "03f4b70b-c32e-422c-856a-2edb0656df4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:08:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] No waiting events found dispatching network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:08:58 user nova-compute[71312]: WARNING nova.compute.manager [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Received unexpected event network-vif-plugged-5803dbac-c755-47eb-93a1-ff9e122638f9 for instance with vm_state deleted and task_state None.
Apr 14 06:09:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:09:11 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452536.6351671, 03f4b70b-c32e-422c-856a-2edb0656df4b => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:09:11 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] VM Stopped (Lifecycle Event)
Apr 14 06:09:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2bdd4204-be26-4668-a552-5d2ce8d10d26 None None] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:09:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-changed-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Refreshing instance network info cache due to event network-changed-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] Acquiring lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:09:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] Acquired lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:09:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Refreshing network info cache for port 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:09:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updated VIF entry in instance network info cache for port 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:09:14 user nova-compute[71312]: DEBUG nova.network.neutron [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating instance_info_cache with network_info: [{"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] Releasing lock "refresh_cache-21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:09:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:16 user nova-compute[71312]: INFO nova.compute.manager [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Terminating instance
Apr 14 06:09:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-vif-unplugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] No waiting events found dispatching network-vif-unplugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.compute.manager [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-vif-unplugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Instance destroyed successfully.
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'resources' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-364162703',display_name='tempest-SnapshotDataIntegrityTests-server-364162703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-364162703',id=32,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY8ZVbsTmU4ya1X7CGgOE6pcyq/4JaVNXY5tpenUcguUdFE8Kr0l/yOIZh+Yt4iEVbu9gJoTSw/kQyo17gRa6Ht+rT1wWxHk+Zl701QDRQbrj4e5WxGPZquLRvwOzCLNQ==',key_name='tempest-SnapshotDataIntegrityTests-543536161',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ed03c728ca4f37b84f644a501f3f85',ramdisk_id='',reservation_id='r-4n8zs3ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1995100522',owner_user_name='tempest-SnapshotDataIntegrityTests-1995100522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:02:47Z,user_data=None,user_id='44c8bc2bd90742dab8b74d340bd9d9b7',uuid=21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Converting VIF {"id": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "address": "fa:16:3e:ed:0c:d4", "network": {"id": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1773237698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ed03c728ca4f37b84f644a501f3f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa2ad6f-43", "ovs_interfaceid": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:0c:d4,bridge_name='br-int',has_traffic_filtering=True,id=6fa2ad6f-43e9-42a0-961b-5b0b3af834fa,network=Network(6110eea6-64ff-49e4-9ef9-6b9be59a7a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa2ad6f-43') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG os_vif [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:0c:d4,bridge_name='br-int',has_traffic_filtering=True,id=6fa2ad6f-43e9-42a0-961b-5b0b3af834fa,network=Network(6110eea6-64ff-49e4-9ef9-6b9be59a7a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa2ad6f-43') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fa2ad6f-43, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:09:17 user nova-compute[71312]: INFO os_vif [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:0c:d4,bridge_name='br-int',has_traffic_filtering=True,id=6fa2ad6f-43e9-42a0-961b-5b0b3af834fa,network=Network(6110eea6-64ff-49e4-9ef9-6b9be59a7a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa2ad6f-43')
Apr 14 06:09:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Deleting instance files /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3_del
Apr 14 06:09:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Deletion of /opt/stack/data/nova/instances/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3_del complete
Apr 14 06:09:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:17 user nova-compute[71312]: INFO nova.compute.manager [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 14 06:09:17 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:09:17 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:09:18 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:18 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Took 0.64 seconds to deallocate network for instance.
Apr 14 06:09:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-vif-deleted-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:18 user nova-compute[71312]: INFO nova.compute.manager [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Neutron deleted interface 6fa2ad6f-43e9-42a0-961b-5b0b3af834fa; detaching it from the instance and deleting it from the info cache
Apr 14 06:09:18 user nova-compute[71312]: DEBUG nova.network.neutron [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Detach interface failed, port_id=6fa2ad6f-43e9-42a0-961b-5b0b3af834fa, reason: Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 06:09:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:09:18 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:09:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:18 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Deleted allocations for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3
Apr 14 06:09:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.811s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received event network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] Acquiring lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] Lock "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] No waiting events found dispatching network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:09:19 user nova-compute[71312]: WARNING nova.compute.manager [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Received unexpected event network-vif-plugged-6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance with vm_state deleted and task_state None.
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:19 user nova-compute[71312]: INFO nova.compute.manager [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Terminating instance
Apr 14 06:09:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-unplugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Instance destroyed successfully.
Apr 14 06:09:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:09:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8520MB free_disk=26.083251953125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'resources' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-793349449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-793349449',id=20,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-ox3x0y2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:57:23Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=46ae7eba-11e8-4a56-b368-739848ed9dbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "address": "fa:16:3e:a0:32:c0", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfcb341-1a", "ovs_interfaceid": "9dfcb341-1a5c-4661-8f34-e559acf931b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:32:c0,bridge_name='br-int',has_traffic_filtering=True,id=9dfcb341-1a5c-4661-8f34-e559acf931b9,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfcb341-1a') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_vif [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:32:c0,bridge_name='br-int',has_traffic_filtering=True,id=9dfcb341-1a5c-4661-8f34-e559acf931b9,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfcb341-1a') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dfcb341-1a, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:09:21 user nova-compute[71312]: INFO os_vif [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:32:c0,bridge_name='br-int',has_traffic_filtering=True,id=9dfcb341-1a5c-4661-8f34-e559acf931b9,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfcb341-1a')
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzpPQqJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:09:21 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[47113be3-b99c-442a-abcd-daa73e8ec800]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:09:21 user nova-compute[71312]: No targets found.
Apr 14 06:09:21 user nova-compute[71312]: iSNS:
Apr 14 06:09:21 user nova-compute[71312]: No targets found.
Apr 14 06:09:21 user nova-compute[71312]: STATIC:
Apr 14 06:09:21 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9
Apr 14 06:09:21 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:09:21 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:09:21 user nova-compute[71312]: FIRMWARE:
Apr 14 06:09:21 user nova-compute[71312]: No targets found.
Apr 14 06:09:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:09:21 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:09:21 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 5c09efbc-4c94-4130-a927-9239420b7d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea8ea82-70cb-4115-8309-619f548f638b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fab27c3-b524-48bd-855b-49878f4d736c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:09:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 (non-flash)
Apr 14 06:09:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc12e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9'): ({'sde'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Removing single pathed devices sde {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d862577-7708-4f68-b4f5-98fc3e5bb130]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[530c379e-6749-4d70-bd2f-bbb120f1c43e]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flushing IO for device /dev/sde {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[47edcadb-142d-4692-8a09-03bc6319c99c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe8b271-60e7-4673-8c18-3814f2fc97b5]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] SCSI volumes sde have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f6b420-a8f4-4a00-9443-4db921dbe69f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e176edd6-55f3-411b-85e0-06e3954f0ffe]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9, portal: 172.16.0.220,3260]
Apr 14 06:09:21 user nova-compute[71312]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9, portal: 172.16.0.220,3260] successful.
Apr 14 06:09:21 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d68490bf-7fe3-4500-95a7-4f29aed845f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ccd2f5-cc66-4726-980e-9833392c05ab]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] <== disconnect_volume: return (293ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:09:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Deleting instance files /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc_del
Apr 14 06:09:21 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Deletion of /opt/stack/data/nova/instances/46ae7eba-11e8-4a56-b368-739848ed9dbc_del complete
Apr 14 06:09:21 user nova-compute[71312]: INFO nova.compute.manager [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Took 1.47 seconds to destroy the instance on the hypervisor.
Apr 14 06:09:21 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:09:21 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:09:22 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-deleted-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:22 user nova-compute[71312]: INFO nova.compute.manager [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Neutron deleted interface 9dfcb341-1a5c-4661-8f34-e559acf931b9; detaching it from the instance and deleting it from the info cache
Apr 14 06:09:22 user nova-compute[71312]: DEBUG nova.network.neutron [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:22 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Took 0.75 seconds to deallocate network for instance.
Apr 14 06:09:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Detach interface failed, port_id=9dfcb341-1a5c-4661-8f34-e559acf931b9, reason: Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 06:09:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] Acquiring lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] No waiting events found dispatching network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:09:22 user nova-compute[71312]: WARNING nova.compute.manager [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Received unexpected event network-vif-plugged-9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance with vm_state active and task_state deleting.
Apr 14 06:09:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:22 user nova-compute[71312]: INFO nova.compute.manager [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 06:09:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:23 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:09:23 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:09:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:23 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Deleted allocations for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc
Apr 14 06:09:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "46ae7eba-11e8-4a56-b368-739848ed9dbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.353s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:09:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:09:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:09:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:09:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:09:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:09:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 5c09efbc-4c94-4130-a927-9239420b7d37 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:09:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updating instance_info_cache with network_info: [{"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-5c09efbc-4c94-4130-a927-9239420b7d37" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:09:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:09:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:09:32 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452557.6776607, 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:09:32 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] VM Stopped (Lifecycle Event)
Apr 14 06:09:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-da83928f-b45e-427d-a7e8-f965c7c2554f None None] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:09:35 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452560.6931827, 46ae7eba-11e8-4a56-b368-739848ed9dbc => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:09:35 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] VM Stopped (Lifecycle Event)
Apr 14 06:09:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a52c66a2-c35e-4bdd-b853-0b833ec9c544 None None] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:09:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:09:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:09:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:09:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:09:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:09:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:09:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:09:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:09:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:09:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:49 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:09:49 user nova-compute[71312]: INFO nova.compute.claims [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Claim successful on node user
Apr 14 06:09:49 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:09:49 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:09:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.policy [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:09:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Creating image(s)
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "/opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "/opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "/opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04d16650ec2c47613ea23f3d7b69f6cff4ce183b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04d16650ec2c47613ea23f3d7b69f6cff4ce183b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b.part --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b.part --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.virt.images [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 2b01c0ae-81f1-467e-b60a-a042f9451f03 was qcow2, converting to raw {{(pid=71312) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.privsep.utils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71312) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b.part /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b.converted {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Successfully created port: e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b.part /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b.converted" returned: 0 in 0.307s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b.converted --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04d16650ec2c47613ea23f3d7b69f6cff4ce183b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.896s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04d16650ec2c47613ea23f3d7b69f6cff4ce183b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04d16650ec2c47613ea23f3d7b69f6cff4ce183b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b,backing_fmt=raw /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b,backing_fmt=raw /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk 1073741824" returned: 0 in 0.105s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04d16650ec2c47613ea23f3d7b69f6cff4ce183b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Successfully updated port: e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing instance network info cache due to event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] Acquiring lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] Acquired lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Cannot resize image /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'migration_context' on Instance uuid 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Ensure instance console log exists: /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] Releasing lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquired lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Releasing lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance network_info: |[{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Start _get_guest_xml network_info=[{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T06:09:47Z,direct_url=<?>,disk_format='qcow2',id=2b01c0ae-81f1-467e-b60a-a042f9451f03,min_disk=0,min_ram=0,name='tempest-scenario-img--931756618',owner='7a4e84122c3c4cb68c55043fd3c4db35',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T06:09:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '2b01c0ae-81f1-467e-b60a-a042f9451f03'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:09:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:09:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T06:09:47Z,direct_url=<?>,disk_format='qcow2',id=2b01c0ae-81f1-467e-b60a-a042f9451f03,min_disk=0,min_ram=0,name='tempest-scenario-img--931756618',owner='7a4e84122c3c4cb68c55043fd3c4db35',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T06:09:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-490473571',display_name='tempest-TestMinimumBasicScenario-server-490473571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-490473571',id=36,image_ref='2b01c0ae-81f1-467e-b60a-a042f9451f03',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6717EzUGPxpTDGefgn7rftigYth+LN1b3MDw9UEhO4TFyX7K4H3Y2IEbim4etXBQkV03TLTzHm/4DHGPKSs7S1l1Q1oGMK8FZaaRruTC6RsXI+5MtzYR1tXUiaq7CGuQ==',key_name='tempest-TestMinimumBasicScenario-837934314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-kj9ys0el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2b01c0ae-81f1-467e-b60a-a042f9451f03',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:09:50Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=10c629c7-bbc9-4ddc-8284-64017419fada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:43,bridge_name='br-int',has_traffic_filtering=True,id=e9e38732-b365-4366-9985-4bd8392b49a2,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e38732-b3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'pci_devices' on Instance uuid 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:09:52 user nova-compute[71312]:   <uuid>10c629c7-bbc9-4ddc-8284-64017419fada</uuid>
Apr 14 06:09:52 user nova-compute[71312]:   <name>instance-00000024</name>
Apr 14 06:09:52 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:09:52 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:09:52 user nova-compute[71312]:   <metadata>
Apr 14 06:09:52 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:09:52 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:09:52 user nova-compute[71312]:       <nova:name>tempest-TestMinimumBasicScenario-server-490473571</nova:name>
Apr 14 06:09:52 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:09:52</nova:creationTime>
Apr 14 06:09:52 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:09:52 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:09:52 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:09:52 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:09:52 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:09:52 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:09:52 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:09:52 user nova-compute[71312]:       <nova:owner>
Apr 14 06:09:52 user nova-compute[71312]:         <nova:user uuid="b59b8f9b395149c7a2eef067766f0935">tempest-TestMinimumBasicScenario-17585386-project-member</nova:user>
Apr 14 06:09:52 user nova-compute[71312]:         <nova:project uuid="7a4e84122c3c4cb68c55043fd3c4db35">tempest-TestMinimumBasicScenario-17585386</nova:project>
Apr 14 06:09:52 user nova-compute[71312]:       </nova:owner>
Apr 14 06:09:52 user nova-compute[71312]:       <nova:root type="image" uuid="2b01c0ae-81f1-467e-b60a-a042f9451f03"/>
Apr 14 06:09:52 user nova-compute[71312]:       <nova:ports>
Apr 14 06:09:52 user nova-compute[71312]:         <nova:port uuid="e9e38732-b365-4366-9985-4bd8392b49a2">
Apr 14 06:09:52 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 06:09:52 user nova-compute[71312]:         </nova:port>
Apr 14 06:09:52 user nova-compute[71312]:       </nova:ports>
Apr 14 06:09:52 user nova-compute[71312]:     </nova:instance>
Apr 14 06:09:52 user nova-compute[71312]:   </metadata>
Apr 14 06:09:52 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:09:52 user nova-compute[71312]:     <system>
Apr 14 06:09:52 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:09:52 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:09:52 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:09:52 user nova-compute[71312]:       <entry name="serial">10c629c7-bbc9-4ddc-8284-64017419fada</entry>
Apr 14 06:09:52 user nova-compute[71312]:       <entry name="uuid">10c629c7-bbc9-4ddc-8284-64017419fada</entry>
Apr 14 06:09:52 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:09:52 user nova-compute[71312]:     </system>
Apr 14 06:09:52 user nova-compute[71312]:   </sysinfo>
Apr 14 06:09:52 user nova-compute[71312]:   <os>
Apr 14 06:09:52 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:09:52 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:09:52 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:09:52 user nova-compute[71312]:   </os>
Apr 14 06:09:52 user nova-compute[71312]:   <features>
Apr 14 06:09:52 user nova-compute[71312]:     <acpi/>
Apr 14 06:09:52 user nova-compute[71312]:     <apic/>
Apr 14 06:09:52 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:09:52 user nova-compute[71312]:   </features>
Apr 14 06:09:52 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:09:52 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:09:52 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:09:52 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:09:52 user nova-compute[71312]:   </clock>
Apr 14 06:09:52 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:09:52 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:09:52 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:09:52 user nova-compute[71312]:   </cpu>
Apr 14 06:09:52 user nova-compute[71312]:   <devices>
Apr 14 06:09:52 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:09:52 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:09:52 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk"/>
Apr 14 06:09:52 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:09:52 user nova-compute[71312]:     </disk>
Apr 14 06:09:52 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:09:52 user nova-compute[71312]:       <mac address="fa:16:3e:b4:86:43"/>
Apr 14 06:09:52 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:09:52 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:09:52 user nova-compute[71312]:       <target dev="tape9e38732-b3"/>
Apr 14 06:09:52 user nova-compute[71312]:     </interface>
Apr 14 06:09:52 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:09:52 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/console.log" append="off"/>
Apr 14 06:09:52 user nova-compute[71312]:     </serial>
Apr 14 06:09:52 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:09:52 user nova-compute[71312]:     <video>
Apr 14 06:09:52 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:09:52 user nova-compute[71312]:     </video>
Apr 14 06:09:52 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:09:52 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:09:52 user nova-compute[71312]:     </rng>
Apr 14 06:09:52 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:09:52 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:09:52 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:09:52 user nova-compute[71312]:     </memballoon>
Apr 14 06:09:52 user nova-compute[71312]:   </devices>
Apr 14 06:09:52 user nova-compute[71312]: </domain>
Apr 14 06:09:52 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-490473571',display_name='tempest-TestMinimumBasicScenario-server-490473571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-490473571',id=36,image_ref='2b01c0ae-81f1-467e-b60a-a042f9451f03',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6717EzUGPxpTDGefgn7rftigYth+LN1b3MDw9UEhO4TFyX7K4H3Y2IEbim4etXBQkV03TLTzHm/4DHGPKSs7S1l1Q1oGMK8FZaaRruTC6RsXI+5MtzYR1tXUiaq7CGuQ==',key_name='tempest-TestMinimumBasicScenario-837934314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-kj9ys0el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2b01c0ae-81f1-467e-b60a-a042f9451f03',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:09:50Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=10c629c7-bbc9-4ddc-8284-64017419fada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:43,bridge_name='br-int',has_traffic_filtering=True,id=e9e38732-b365-4366-9985-4bd8392b49a2,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e38732-b3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG os_vif [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:43,bridge_name='br-int',has_traffic_filtering=True,id=e9e38732-b365-4366-9985-4bd8392b49a2,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e38732-b3') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-changed-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Refreshing instance network info cache due to event network-changed-1368a896-f16c-4222-9542-c591daa2e361. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] Acquiring lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] Acquired lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Refreshing network info cache for port 1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9e38732-b3, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9e38732-b3, col_values=(('external_ids', {'iface-id': 'e9e38732-b365-4366-9985-4bd8392b49a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:86:43', 'vm-uuid': '10c629c7-bbc9-4ddc-8284-64017419fada'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:52 user nova-compute[71312]: INFO os_vif [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:43,bridge_name='br-int',has_traffic_filtering=True,id=e9e38732-b365-4366-9985-4bd8392b49a2,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e38732-b3')
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:09:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No VIF found with MAC fa:16:3e:b4:86:43, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:09:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updated VIF entry in instance network info cache for port 1368a896-f16c-4222-9542-c591daa2e361. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:09:53 user nova-compute[71312]: DEBUG nova.network.neutron [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updating instance_info_cache with network_info: [{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:09:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] Releasing lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:09:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:09:54 user nova-compute[71312]: WARNING nova.compute.manager [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state building and task_state spawning.
Apr 14 06:09:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452596.0133803, 10c629c7-bbc9-4ddc-8284-64017419fada => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:09:56 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] VM Resumed (Lifecycle Event)
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:09:56 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance spawned successfully.
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:09:56 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452596.016525, 10c629c7-bbc9-4ddc-8284-64017419fada => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:09:56 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] VM Started (Lifecycle Event)
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:09:56 user nova-compute[71312]: INFO nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Took 5.86 seconds to spawn the instance on the hypervisor.
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:09:56 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:09:56 user nova-compute[71312]: INFO nova.compute.manager [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Took 6.47 seconds to build instance.
Apr 14 06:09:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.568s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:09:56 user nova-compute[71312]: WARNING nova.compute.manager [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state active and task_state None.
Apr 14 06:09:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:09:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:09:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:09:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:09:57 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:09:57 user nova-compute[71312]: INFO nova.compute.claims [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Claim successful on node user
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:09:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:09:58 user nova-compute[71312]: INFO nova.virt.block_device [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Booting with volume e98f1b81-0e6e-43f4-ae89-22875745113b at /dev/vda
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.policy [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG os_brick.utils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3a7824-ecb7-49aa-95b6-e9fbdee63a8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7e6b61-0e22-4ddf-9420-934168db5a6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d037e51-c31f-4664-9013-a0f860c73b46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4ea863-5c7e-4c8b-8777-8e6ba403e0c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:09:58 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:09:58 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7c0c73-9f69-49ce-a16c-efe04982198d]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG os_brick.utils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating existing volume attachment record: 770da382-e65b-4085-805b-878498777b68 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:09:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Successfully created port: 7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:09:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Successfully updated port: 7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:09:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:09:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:09:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:09:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-changed-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:09:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Refreshing instance network info cache due to event network-changed-7257f770-94f7-4c6a-aefd-c1aaeb04af04. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:09:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] Acquiring lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:09:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:10:00 user nova-compute[71312]: DEBUG nova.network.neutron [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating instance_info_cache with network_info: [{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:10:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:10:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance network_info: |[{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:10:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] Acquired lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:10:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Refreshing network info cache for port 7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:10:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updated VIF entry in instance network info cache for port 7257f770-94f7-4c6a-aefd-c1aaeb04af04. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:10:00 user nova-compute[71312]: DEBUG nova.network.neutron [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating instance_info_cache with network_info: [{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:10:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] Releasing lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:10:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:10:03 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Creating image(s)
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Ensure instance console log exists: /opt/stack/data/nova/instances/216d6140-f106-4928-aa06-bc2d9e860f32/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Start _get_guest_xml network_info=[{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '770da382-e65b-4085-805b-878498777b68', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQwtsKIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '216d6140-f106-4928-aa06-bc2d9e860f32', 'attached_at': '', 'detached_at': '', 'volume_id': 'e98f1b81-0e6e-43f4-ae89-22875745113b', 'serial': 'e98f1b81-0e6e-43f4-ae89-22875745113b'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:10:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:10:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQwtsKIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:10:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:10:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:10:03 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf18c10-82a0-48fb-b919-916d9d9bbf5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:10:03 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a90945-eaca-42c1-be3e-b3880b2bc875]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b] added
Apr 14 06:10:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e86ebcf-3743-4c29-ae19-a5521f08c567]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[97761537-1e51-48e9-9c84-dbbd4a8315ae]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQwtsKIm {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQwtsKIm" returned: 0 in 0.028s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38b2868-e33b-4a48-b18d-18f67b98b0b9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fQwtsKIm'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d419e8-7db6-4ff5-98a8-d6f720aa9a01]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9235dc7e-e1c7-4e99-8583-282456af406e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:10:03 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:10:03 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:10:03 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 06:10:03 user nova-compute[71312]: 
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b64ec9-0113-47b2-83f2-9f0e7e1d4c74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260]
Apr 14 06:10:03 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260] successful.
Apr 14 06:10:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a7bacb-e9dc-4bb2-b0e4-d21087c6899e]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59f86b2-612b-40fc-9f77-24ce0f3c3c03]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:10:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:10:03 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee0159d-f30d-4d43-8c15-61935b1755f1]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:10:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQwtsKIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23265356138393936', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265356138393936', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1934317016',display_name='tempest-ServerActionsTestJSON-server-1934317016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1934317016',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-dk4balnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=216d6140-f106-4928-aa06-bc2d9e860f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.objects.instance [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_devices' on Instance uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:10:04 user nova-compute[71312]:   <uuid>216d6140-f106-4928-aa06-bc2d9e860f32</uuid>
Apr 14 06:10:04 user nova-compute[71312]:   <name>instance-00000025</name>
Apr 14 06:10:04 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:10:04 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:10:04 user nova-compute[71312]:   <metadata>
Apr 14 06:10:04 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:10:04 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:10:04 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestJSON-server-1934317016</nova:name>
Apr 14 06:10:04 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:10:03</nova:creationTime>
Apr 14 06:10:04 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:10:04 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:10:04 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:10:04 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:10:04 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:10:04 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:10:04 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:10:04 user nova-compute[71312]:       <nova:owner>
Apr 14 06:10:04 user nova-compute[71312]:         <nova:user uuid="290b67b22a91443fbfc829fa4e3db036">tempest-ServerActionsTestJSON-31064769-project-member</nova:user>
Apr 14 06:10:04 user nova-compute[71312]:         <nova:project uuid="dbc4321a7868464faa59341018ed747f">tempest-ServerActionsTestJSON-31064769</nova:project>
Apr 14 06:10:04 user nova-compute[71312]:       </nova:owner>
Apr 14 06:10:04 user nova-compute[71312]:       <nova:ports>
Apr 14 06:10:04 user nova-compute[71312]:         <nova:port uuid="7257f770-94f7-4c6a-aefd-c1aaeb04af04">
Apr 14 06:10:04 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 06:10:04 user nova-compute[71312]:         </nova:port>
Apr 14 06:10:04 user nova-compute[71312]:       </nova:ports>
Apr 14 06:10:04 user nova-compute[71312]:     </nova:instance>
Apr 14 06:10:04 user nova-compute[71312]:   </metadata>
Apr 14 06:10:04 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:10:04 user nova-compute[71312]:     <system>
Apr 14 06:10:04 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:10:04 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:10:04 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:10:04 user nova-compute[71312]:       <entry name="serial">216d6140-f106-4928-aa06-bc2d9e860f32</entry>
Apr 14 06:10:04 user nova-compute[71312]:       <entry name="uuid">216d6140-f106-4928-aa06-bc2d9e860f32</entry>
Apr 14 06:10:04 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:10:04 user nova-compute[71312]:     </system>
Apr 14 06:10:04 user nova-compute[71312]:   </sysinfo>
Apr 14 06:10:04 user nova-compute[71312]:   <os>
Apr 14 06:10:04 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:10:04 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:10:04 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:10:04 user nova-compute[71312]:   </os>
Apr 14 06:10:04 user nova-compute[71312]:   <features>
Apr 14 06:10:04 user nova-compute[71312]:     <acpi/>
Apr 14 06:10:04 user nova-compute[71312]:     <apic/>
Apr 14 06:10:04 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:10:04 user nova-compute[71312]:   </features>
Apr 14 06:10:04 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:10:04 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:10:04 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:10:04 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:10:04 user nova-compute[71312]:   </clock>
Apr 14 06:10:04 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:10:04 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:10:04 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:10:04 user nova-compute[71312]:   </cpu>
Apr 14 06:10:04 user nova-compute[71312]:   <devices>
Apr 14 06:10:04 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:10:04 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:10:04 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 06:10:04 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:10:04 user nova-compute[71312]:       <serial>e98f1b81-0e6e-43f4-ae89-22875745113b</serial>
Apr 14 06:10:04 user nova-compute[71312]:     </disk>
Apr 14 06:10:04 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:10:04 user nova-compute[71312]:       <mac address="fa:16:3e:d0:83:76"/>
Apr 14 06:10:04 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:10:04 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:10:04 user nova-compute[71312]:       <target dev="tap7257f770-94"/>
Apr 14 06:10:04 user nova-compute[71312]:     </interface>
Apr 14 06:10:04 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:10:04 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/216d6140-f106-4928-aa06-bc2d9e860f32/console.log" append="off"/>
Apr 14 06:10:04 user nova-compute[71312]:     </serial>
Apr 14 06:10:04 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:10:04 user nova-compute[71312]:     <video>
Apr 14 06:10:04 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:10:04 user nova-compute[71312]:     </video>
Apr 14 06:10:04 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:10:04 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:10:04 user nova-compute[71312]:     </rng>
Apr 14 06:10:04 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:10:04 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:10:04 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:10:04 user nova-compute[71312]:     </memballoon>
Apr 14 06:10:04 user nova-compute[71312]:   </devices>
Apr 14 06:10:04 user nova-compute[71312]: </domain>
Apr 14 06:10:04 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1934317016',display_name='tempest-ServerActionsTestJSON-server-1934317016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1934317016',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-dk4balnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=216d6140-f106-4928-aa06-bc2d9e860f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG os_vif [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7257f770-94, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7257f770-94, col_values=(('external_ids', {'iface-id': '7257f770-94f7-4c6a-aefd-c1aaeb04af04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:83:76', 'vm-uuid': '216d6140-f106-4928-aa06-bc2d9e860f32'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:04 user nova-compute[71312]: INFO os_vif [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94')
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:10:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No VIF found with MAC fa:16:3e:d0:83:76, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:10:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:10:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:06 user nova-compute[71312]: DEBUG nova.compute.manager [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:10:06 user nova-compute[71312]: WARNING nova.compute.manager [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state building and task_state spawning.
Apr 14 06:10:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452608.0478587, 216d6140-f106-4928-aa06-bc2d9e860f32 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:10:08 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] VM Resumed (Lifecycle Event)
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:10:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance spawned successfully.
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:10:08 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452608.0517392, 216d6140-f106-4928-aa06-bc2d9e860f32 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:10:08 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] VM Started (Lifecycle Event)
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:10:08 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:10:08 user nova-compute[71312]: WARNING nova.compute.manager [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state building and task_state spawning.
Apr 14 06:10:08 user nova-compute[71312]: INFO nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Took 4.98 seconds to spawn the instance on the hypervisor.
Apr 14 06:10:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:10:08 user nova-compute[71312]: INFO nova.compute.manager [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Took 10.42 seconds to build instance.
Apr 14 06:10:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.519s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "5c09efbc-4c94-4130-a927-9239420b7d37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:10 user nova-compute[71312]: INFO nova.compute.manager [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Terminating instance
Apr 14 06:10:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received event network-vif-unplugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] No waiting events found dispatching network-vif-unplugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received event network-vif-unplugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:10:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Instance destroyed successfully.
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'resources' on Instance uuid 5c09efbc-4c94-4130-a927-9239420b7d37 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T05:50:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1574771686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1574771686',id=15,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T05:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7034e2177823496a861a1601a5c06fe4',ramdisk_id='',reservation_id='r-cvkivi41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-315541711',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T05:52:33Z,user_data=None,user_id='c4946885e01a4f0da206d796027b3c9f',uuid=5c09efbc-4c94-4130-a927-9239420b7d37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converting VIF {"id": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "address": "fa:16:3e:db:0b:53", "network": {"id": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1898955698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7034e2177823496a861a1601a5c06fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056b7c6a-6f", "ovs_interfaceid": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=056b7c6a-6fa1-4a4a-ba45-3084cfc33643,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056b7c6a-6f') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG os_vif [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=056b7c6a-6fa1-4a4a-ba45-3084cfc33643,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056b7c6a-6f') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap056b7c6a-6f, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:10:11 user nova-compute[71312]: INFO os_vif [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=056b7c6a-6fa1-4a4a-ba45-3084cfc33643,network=Network(49b7a0c9-3ca2-4c36-af90-eb33b55fde50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056b7c6a-6f')
Apr 14 06:10:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Deleting instance files /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37_del
Apr 14 06:10:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Deletion of /opt/stack/data/nova/instances/5c09efbc-4c94-4130-a927-9239420b7d37_del complete
Apr 14 06:10:11 user nova-compute[71312]: INFO nova.compute.manager [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 06:10:11 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:10:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:10:12 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:10:12 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Took 0.89 seconds to deallocate network for instance.
Apr 14 06:10:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-cdb9cf32-990e-4698-b4c8-6e469518874a req-8739ae46-c684-4486-a7a3-707bf6b8a05e service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received event network-vif-deleted-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:10:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:12 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:10:12 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:10:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:12 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Deleted allocations for instance 5c09efbc-4c94-4130-a927-9239420b7d37
Apr 14 06:10:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "5c09efbc-4c94-4130-a927-9239420b7d37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.139s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received event network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:10:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] Acquiring lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] Lock "5c09efbc-4c94-4130-a927-9239420b7d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] No waiting events found dispatching network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:10:13 user nova-compute[71312]: WARNING nova.compute.manager [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Received unexpected event network-vif-plugged-056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance with vm_state deleted and task_state None.
Apr 14 06:10:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:19 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:10:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:10:20 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:10:20 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:10:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=26.135238647460938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 10c629c7-bbc9-4ddc-8284-64017419fada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:10:20 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:10:21 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:10:21 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:10:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:10:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:10:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:26 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452611.334333, 5c09efbc-4c94-4130-a927-9239420b7d37 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:10:26 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] VM Stopped (Lifecycle Event)
Apr 14 06:10:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-735eb62d-158f-4232-900a-5adf1d59e915 None None] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:10:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:10:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:10:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:10:26 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:10:27 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updating instance_info_cache with network_info: [{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:10:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:10:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:10:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:10:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:10:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:10:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:10:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:11:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:11:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:11:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:11:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:11:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:14 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:11:14 user nova-compute[71312]: INFO nova.compute.claims [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Claim successful on node user
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:11:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.policy [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:11:15 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Creating image(s)
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "/opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "/opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "/opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.126s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk 1073741824" returned: 0 in 0.056s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Cannot resize image /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.objects.instance [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'migration_context' on Instance uuid 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.network.neutron [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Successfully created port: 51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Ensure instance console log exists: /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:15 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Successfully updated port: 51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquired lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received event network-changed-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Refreshing instance network info cache due to event network-changed-51eac7c6-f096-473a-90ae-534ed4210867. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] Acquiring lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.network.neutron [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updating instance_info_cache with network_info: [{"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Releasing lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Instance network_info: |[{"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] Acquired lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.network.neutron [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Refreshing network info cache for port 51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Start _get_guest_xml network_info=[{"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:11:16 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:11:16 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2028846765',display_name='tempest-AttachVolumeNegativeTest-server-2028846765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2028846765',id=38,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6TF+Zg8ftP47ylXb1K6XxWAu4TjAIiWKAEJPZubTTV6Po1otD7NtEzR0XXRZ+xy6RMchrhrvyJqfpCw1RQiMKvQ71lI2KS+6GWglZOJBgoHB+VsSVOJvbvbgum5X9zjQ==',key_name='tempest-keypair-1140459230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-jxg5o2ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=659408d9-ad86-4482-82dd-710e064e02a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=51eac7c6-f096-473a-90ae-534ed4210867,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51eac7c6-f0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:11:16 user nova-compute[71312]: DEBUG nova.objects.instance [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'pci_devices' on Instance uuid 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:11:17 user nova-compute[71312]:   <uuid>659408d9-ad86-4482-82dd-710e064e02a1</uuid>
Apr 14 06:11:17 user nova-compute[71312]:   <name>instance-00000026</name>
Apr 14 06:11:17 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:11:17 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:11:17 user nova-compute[71312]:   <metadata>
Apr 14 06:11:17 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:11:17 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:11:17 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2028846765</nova:name>
Apr 14 06:11:17 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:11:16</nova:creationTime>
Apr 14 06:11:17 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:11:17 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:11:17 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:11:17 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:11:17 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:11:17 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:11:17 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:11:17 user nova-compute[71312]:       <nova:owner>
Apr 14 06:11:17 user nova-compute[71312]:         <nova:user uuid="6ce33b21c6d541a0a4885680baf52f64">tempest-AttachVolumeNegativeTest-426432803-project-member</nova:user>
Apr 14 06:11:17 user nova-compute[71312]:         <nova:project uuid="86f67a892b9045089159f210e7db3a80">tempest-AttachVolumeNegativeTest-426432803</nova:project>
Apr 14 06:11:17 user nova-compute[71312]:       </nova:owner>
Apr 14 06:11:17 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:11:17 user nova-compute[71312]:       <nova:ports>
Apr 14 06:11:17 user nova-compute[71312]:         <nova:port uuid="51eac7c6-f096-473a-90ae-534ed4210867">
Apr 14 06:11:17 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 06:11:17 user nova-compute[71312]:         </nova:port>
Apr 14 06:11:17 user nova-compute[71312]:       </nova:ports>
Apr 14 06:11:17 user nova-compute[71312]:     </nova:instance>
Apr 14 06:11:17 user nova-compute[71312]:   </metadata>
Apr 14 06:11:17 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:11:17 user nova-compute[71312]:     <system>
Apr 14 06:11:17 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:11:17 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:11:17 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:11:17 user nova-compute[71312]:       <entry name="serial">659408d9-ad86-4482-82dd-710e064e02a1</entry>
Apr 14 06:11:17 user nova-compute[71312]:       <entry name="uuid">659408d9-ad86-4482-82dd-710e064e02a1</entry>
Apr 14 06:11:17 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:11:17 user nova-compute[71312]:     </system>
Apr 14 06:11:17 user nova-compute[71312]:   </sysinfo>
Apr 14 06:11:17 user nova-compute[71312]:   <os>
Apr 14 06:11:17 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:11:17 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:11:17 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:11:17 user nova-compute[71312]:   </os>
Apr 14 06:11:17 user nova-compute[71312]:   <features>
Apr 14 06:11:17 user nova-compute[71312]:     <acpi/>
Apr 14 06:11:17 user nova-compute[71312]:     <apic/>
Apr 14 06:11:17 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:11:17 user nova-compute[71312]:   </features>
Apr 14 06:11:17 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:11:17 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:11:17 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:11:17 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:11:17 user nova-compute[71312]:   </clock>
Apr 14 06:11:17 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:11:17 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:11:17 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:11:17 user nova-compute[71312]:   </cpu>
Apr 14 06:11:17 user nova-compute[71312]:   <devices>
Apr 14 06:11:17 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:11:17 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:11:17 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk"/>
Apr 14 06:11:17 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:11:17 user nova-compute[71312]:     </disk>
Apr 14 06:11:17 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:11:17 user nova-compute[71312]:       <mac address="fa:16:3e:c4:4d:03"/>
Apr 14 06:11:17 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:11:17 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:11:17 user nova-compute[71312]:       <target dev="tap51eac7c6-f0"/>
Apr 14 06:11:17 user nova-compute[71312]:     </interface>
Apr 14 06:11:17 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:11:17 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/console.log" append="off"/>
Apr 14 06:11:17 user nova-compute[71312]:     </serial>
Apr 14 06:11:17 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:11:17 user nova-compute[71312]:     <video>
Apr 14 06:11:17 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:11:17 user nova-compute[71312]:     </video>
Apr 14 06:11:17 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:11:17 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:11:17 user nova-compute[71312]:     </rng>
Apr 14 06:11:17 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:11:17 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:11:17 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:11:17 user nova-compute[71312]:     </memballoon>
Apr 14 06:11:17 user nova-compute[71312]:   </devices>
Apr 14 06:11:17 user nova-compute[71312]: </domain>
Apr 14 06:11:17 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2028846765',display_name='tempest-AttachVolumeNegativeTest-server-2028846765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2028846765',id=38,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6TF+Zg8ftP47ylXb1K6XxWAu4TjAIiWKAEJPZubTTV6Po1otD7NtEzR0XXRZ+xy6RMchrhrvyJqfpCw1RQiMKvQ71lI2KS+6GWglZOJBgoHB+VsSVOJvbvbgum5X9zjQ==',key_name='tempest-keypair-1140459230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-jxg5o2ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=659408d9-ad86-4482-82dd-710e064e02a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=51eac7c6-f096-473a-90ae-534ed4210867,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51eac7c6-f0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG os_vif [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=51eac7c6-f096-473a-90ae-534ed4210867,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51eac7c6-f0') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51eac7c6-f0, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51eac7c6-f0, col_values=(('external_ids', {'iface-id': '51eac7c6-f096-473a-90ae-534ed4210867', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:4d:03', 'vm-uuid': '659408d9-ad86-4482-82dd-710e064e02a1'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:17 user nova-compute[71312]: INFO os_vif [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=51eac7c6-f096-473a-90ae-534ed4210867,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51eac7c6-f0')
Apr 14 06:11:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No VIF found with MAC fa:16:3e:c4:4d:03, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG nova.network.neutron [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updated VIF entry in instance network info cache for port 51eac7c6-f096-473a-90ae-534ed4210867. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG nova.network.neutron [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updating instance_info_cache with network_info: [{"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] Releasing lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received event network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] No waiting events found dispatching network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:11:18 user nova-compute[71312]: WARNING nova.compute.manager [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received unexpected event network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 for instance with vm_state building and task_state spawning.
Apr 14 06:11:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452680.4283435, 659408d9-ad86-4482-82dd-710e064e02a1 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:11:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] VM Resumed (Lifecycle Event)
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:11:20 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Instance spawned successfully.
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:11:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452680.4314654, 659408d9-ad86-4482-82dd-710e064e02a1 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:11:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] VM Started (Lifecycle Event)
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:11:20 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:11:20 user nova-compute[71312]: INFO nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Took 5.26 seconds to spawn the instance on the hypervisor.
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:11:20 user nova-compute[71312]: INFO nova.compute.manager [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Took 5.83 seconds to build instance.
Apr 14 06:11:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.923s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received event network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] No waiting events found dispatching network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:11:20 user nova-compute[71312]: WARNING nova.compute.manager [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received unexpected event network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 for instance with vm_state active and task_state None.
Apr 14 06:11:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:11:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:11:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:11:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8472MB free_disk=26.13250732421875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 10c629c7-bbc9-4ddc-8284-64017419fada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 659408d9-ad86-4482-82dd-710e064e02a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:11:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:11:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:11:28 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 594c89a2-66e3-4d1d-8331-60a6aa03c66c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updating instance_info_cache with network_info: [{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:11:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:11:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:42 user nova-compute[71312]: DEBUG nova.objects.instance [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'flavor' on Instance uuid 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:42 user nova-compute[71312]: INFO nova.compute.manager [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Attaching volume 1fa1963a-1093-4d62-9995-c005329e90ca to /dev/vdb
Apr 14 06:11:43 user nova-compute[71312]: DEBUG os_brick.utils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f033f3-7e1e-4764-94dd-0495a73e3257]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad54540-5eaa-4553-922c-c8dbd86c8de5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c9fc5-34bb-4a17-98b5-b610d4275f90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c420ce-1801-4ce7-b331-5829a3891f33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:11:43 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:11:43 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deeec9e-b43f-4dfb-94bc-508a89e29139]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG os_brick.utils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:11:43 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating existing volume attachment record: e006469d-cc18-4cdb-a815-dad70e76d5cb {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJGpScIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:11:47 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:11:47 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:11:47 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4329a0ce-f626-4dd5-b2e0-433c790041bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:11:47 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aca14f-6171-4720-9c6c-63f241aa121a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca] added
Apr 14 06:11:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c05897-dce0-49b6-af27-a868388fc048]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3426b9c0-b8c3-492d-a559-5f74c22dded7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJGpScIi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJGpScIi" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f09a1f4-3c8e-4be6-8b95-97cced962760]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sJGpScIi'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f61c087-34ab-4aca-9bcb-40c6b1ffce35]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceca5a01-7ba5-4411-bedc-6595001fca00]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:11:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:11:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba232a2-6a75-4d82-ad9f-8c17e5db1dbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca, portal: 172.16.0.220,3260]
Apr 14 06:11:47 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca, portal: 172.16.0.220,3260] successful.
Apr 14 06:11:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dddf92-deb8-4423-9cba-b1538248a72b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62908808-fd14-4510-9200-bf4daad95d9e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:11:47 user nova-compute[71312]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:11:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:11:47 user nova-compute[71312]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:11:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a2ea08-5c2e-4d76-8cdd-83a23a012b8e]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:11:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJGpScIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-changed-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG nova.compute.manager [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Refreshing instance network info cache due to event network-changed-1368a896-f16c-4222-9542-c591daa2e361. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] Acquiring lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] Acquired lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG nova.network.neutron [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Refreshing network info cache for port 1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23561393832303631', 'path': '/dev/sdc'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561393832303631', 'path': '/dev/sdc'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'flavor' on Instance uuid 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:11:48 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:11:48 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:11:48 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:11:48 user nova-compute[71312]:   <serial>1fa1963a-1093-4d62-9995-c005329e90ca</serial>
Apr 14 06:11:48 user nova-compute[71312]: </disk>
Apr 14 06:11:48 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:11:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] No VIF found with MAC fa:16:3e:b4:86:43, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:11:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updated VIF entry in instance network info cache for port 1368a896-f16c-4222-9542-c591daa2e361. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:11:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updating instance_info_cache with network_info: [{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] Releasing lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.391s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Stashing vm_state: active {{(pid=71312) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_requests' on Instance uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:11:50 user nova-compute[71312]: INFO nova.compute.claims [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Claim successful on node user
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'resources' on Instance uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'pci_devices' on Instance uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:50 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating resource usage from migration a8570d58-616d-473e-bf9a-eb1b0f623e48
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.291s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:50 user nova-compute[71312]: INFO nova.compute.manager [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Migrating
Apr 14 06:11:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-changed-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG nova.compute.manager [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Refreshing instance network info cache due to event network-changed-7257f770-94f7-4c6a-aefd-c1aaeb04af04. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:11:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Acquiring lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating instance_info_cache with network_info: [{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Acquired lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Refreshing network info cache for port 7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Starting migrate_disk_and_power_off {{(pid=71312) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:11:51 user nova-compute[71312]: WARNING nova.compute.manager [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state active and task_state resize_migrating.
Apr 14 06:11:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updated VIF entry in instance network info cache for port 7257f770-94f7-4c6a-aefd-c1aaeb04af04. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG nova.network.neutron [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating instance_info_cache with network_info: [{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Releasing lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:52 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance destroyed successfully.
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1934317016',display_name='tempest-ServerActionsTestJSON-server-1934317016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1934317016',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-dk4balnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=216d6140-f106-4928-aa06-bc2d9e860f32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:d0:83:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:d0:83:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_vif [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7257f770-94, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:11:52 user nova-compute[71312]: INFO os_vif [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94')
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQwtsKIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:11:52 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec487d7c-c6e3-4e8f-bac5-e5633bd658b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:11:52 user nova-compute[71312]: No targets found.
Apr 14 06:11:52 user nova-compute[71312]: iSNS:
Apr 14 06:11:52 user nova-compute[71312]: No targets found.
Apr 14 06:11:52 user nova-compute[71312]: STATIC:
Apr 14 06:11:52 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca
Apr 14 06:11:52 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:11:52 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:11:52 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b
Apr 14 06:11:52 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:11:52 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:11:52 user nova-compute[71312]: FIRMWARE:
Apr 14 06:11:52 user nova-compute[71312]: No targets found.
Apr 14 06:11:52 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:11:52 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:11:52 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6725817c-984c-4e8d-990f-b48fccd0c722]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a6d5e4-1836-436d-8e5c-bfe6c9c31b3c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:11:52 user nova-compute[71312]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:11:52 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:11:52 user nova-compute[71312]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:11:52 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc12c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4d70c6-691d-4297-bf64-c2fed88f394c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8b4c38-d9eb-4d26-ae77-7dda4a427a0d]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.compute.manager [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing instance network info cache due to event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] Acquiring lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] Acquired lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29881173-a107-4d79-88cd-365ff26a8eac]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[617fc8db-4e2c-4692-b4fe-c1c07b746ac5]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c891fd0-4393-4cf9-a608-dba243c8258f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98cf634-78f0-486d-a766-9e9025969723]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260]
Apr 14 06:11:52 user nova-compute[71312]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260] successful.
Apr 14 06:11:52 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bd0965-a53b-4dc8-afe6-4b82f82699d5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== disconnect_volume: return (317ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updated VIF entry in instance network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:11:52 user nova-compute[71312]: DEBUG nova.network.neutron [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] Releasing lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Port 7257f770-94f7-4c6a-aefd-c1aaeb04af04 binding to destination host user is already ACTIVE {{(pid=71312) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:53 user nova-compute[71312]: DEBUG nova.compute.manager [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:11:53 user nova-compute[71312]: WARNING nova.compute.manager [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state active and task_state resize_migrated.
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG nova.network.neutron [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating instance_info_cache with network_info: [{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG os_brick.utils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb35424-06f6-478e-8f9b-2865873e25fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcb39a5-463b-46fc-be42-9e052b3701f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55612ea6-a3a9-43fd-a4bd-39949156eb12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc522c0f-74ec-4f88-8f41-6ef3096bc8bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:11:54 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:11:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e02283-6416-42c4-bf2e-830b26b82139]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:11:54 user nova-compute[71312]: DEBUG os_brick.utils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== get_connector_properties: return (236ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:11:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:55 user nova-compute[71312]: INFO nova.compute.manager [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Rebooting instance
Apr 14 06:11:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquired lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:11:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Releasing lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:11:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing instance network info cache due to event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:11:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] Acquiring lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:11:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] Acquired lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:11:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:11:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updated VIF entry in instance network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:11:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:11:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] Releasing lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:11:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-unplugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:11:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:58 user nova-compute[71312]: DEBUG nova.compute.manager [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-unplugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:11:58 user nova-compute[71312]: WARNING nova.compute.manager [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-unplugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state active and task_state reboot_started.
Apr 14 06:11:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance shutdown successfully.
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Starting finish_migration {{(pid=71312) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 06:11:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Creating image(s)
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Ensure instance console log exists: /opt/stack/data/nova/instances/216d6140-f106-4928-aa06-bc2d9e860f32/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Start _get_guest_xml network_info=[{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:d0:83:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '0a232cd4-6a27-496d-9336-70255965b2a0', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQwtsKIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '216d6140-f106-4928-aa06-bc2d9e860f32', 'attached_at': '2023-04-14T06:11:59.000000', 'detached_at': '', 'volume_id': 'e98f1b81-0e6e-43f4-ae89-22875745113b', 'serial': 'e98f1b81-0e6e-43f4-ae89-22875745113b'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:11:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:11:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQwtsKIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:11:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:11:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:11:59 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b1795-664b-492e-a21a-5fcbe4a10502]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:11:59 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f75319-4d3b-4439-b4c7-2dcd532ccb8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b] added
Apr 14 06:11:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[03999364-54f1-482b-ab80-3222ec9fb73a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe356e04-3ec6-4a6b-b392-ae41df623cc7]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQwtsKIm {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQwtsKIm" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5761d770-bbb4-4682-adce-760eda14ec89]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fQwtsKIm'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbb43a1-7826-4570-9a99-4d8b1316caec]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ab03c9-6bff-4171-a4e9-10b599eee079]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:11:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:11:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d506c2eb-9a6b-4997-b269-3eb96137cdea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260]
Apr 14 06:11:59 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260] successful.
Apr 14 06:11:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab1f014-854f-4b0f-b7a3-2c55aed204af]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d238079e-b157-4690-a3f1-047181da2c1a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:11:59 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:11:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:11:59 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:11:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8de1b77-bfdf-4e69-b710-15e49814bef8]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQwtsKIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:11:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.compute.manager [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:12:00 user nova-compute[71312]: WARNING nova.compute.manager [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state active and task_state reboot_started.
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23265356138393936', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265356138393936', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1934317016',display_name='tempest-ServerActionsTestJSON-server-1934317016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1934317016',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-dk4balnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=216d6140-f106-4928-aa06-bc2d9e860f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:d0:83:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:d0:83:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:12:00 user nova-compute[71312]:   <uuid>216d6140-f106-4928-aa06-bc2d9e860f32</uuid>
Apr 14 06:12:00 user nova-compute[71312]:   <name>instance-00000025</name>
Apr 14 06:12:00 user nova-compute[71312]:   <memory>196608</memory>
Apr 14 06:12:00 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:12:00 user nova-compute[71312]:   <metadata>
Apr 14 06:12:00 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:12:00 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:12:00 user nova-compute[71312]:       <nova:name>tempest-ServerActionsTestJSON-server-1934317016</nova:name>
Apr 14 06:12:00 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:11:59</nova:creationTime>
Apr 14 06:12:00 user nova-compute[71312]:       <nova:flavor name="m1.micro">
Apr 14 06:12:00 user nova-compute[71312]:         <nova:memory>192</nova:memory>
Apr 14 06:12:00 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:12:00 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:12:00 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:12:00 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:12:00 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:12:00 user nova-compute[71312]:       <nova:owner>
Apr 14 06:12:00 user nova-compute[71312]:         <nova:user uuid="290b67b22a91443fbfc829fa4e3db036">tempest-ServerActionsTestJSON-31064769-project-member</nova:user>
Apr 14 06:12:00 user nova-compute[71312]:         <nova:project uuid="dbc4321a7868464faa59341018ed747f">tempest-ServerActionsTestJSON-31064769</nova:project>
Apr 14 06:12:00 user nova-compute[71312]:       </nova:owner>
Apr 14 06:12:00 user nova-compute[71312]:       <nova:ports>
Apr 14 06:12:00 user nova-compute[71312]:         <nova:port uuid="7257f770-94f7-4c6a-aefd-c1aaeb04af04">
Apr 14 06:12:00 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 06:12:00 user nova-compute[71312]:         </nova:port>
Apr 14 06:12:00 user nova-compute[71312]:       </nova:ports>
Apr 14 06:12:00 user nova-compute[71312]:     </nova:instance>
Apr 14 06:12:00 user nova-compute[71312]:   </metadata>
Apr 14 06:12:00 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:12:00 user nova-compute[71312]:     <system>
Apr 14 06:12:00 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:12:00 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:12:00 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:12:00 user nova-compute[71312]:       <entry name="serial">216d6140-f106-4928-aa06-bc2d9e860f32</entry>
Apr 14 06:12:00 user nova-compute[71312]:       <entry name="uuid">216d6140-f106-4928-aa06-bc2d9e860f32</entry>
Apr 14 06:12:00 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:12:00 user nova-compute[71312]:     </system>
Apr 14 06:12:00 user nova-compute[71312]:   </sysinfo>
Apr 14 06:12:00 user nova-compute[71312]:   <os>
Apr 14 06:12:00 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:12:00 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:12:00 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:12:00 user nova-compute[71312]:   </os>
Apr 14 06:12:00 user nova-compute[71312]:   <features>
Apr 14 06:12:00 user nova-compute[71312]:     <acpi/>
Apr 14 06:12:00 user nova-compute[71312]:     <apic/>
Apr 14 06:12:00 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:12:00 user nova-compute[71312]:   </features>
Apr 14 06:12:00 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:12:00 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:12:00 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:12:00 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:12:00 user nova-compute[71312]:   </clock>
Apr 14 06:12:00 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:12:00 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:12:00 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:12:00 user nova-compute[71312]:   </cpu>
Apr 14 06:12:00 user nova-compute[71312]:   <devices>
Apr 14 06:12:00 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:12:00 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:12:00 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 06:12:00 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:12:00 user nova-compute[71312]:       <serial>e98f1b81-0e6e-43f4-ae89-22875745113b</serial>
Apr 14 06:12:00 user nova-compute[71312]:     </disk>
Apr 14 06:12:00 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:12:00 user nova-compute[71312]:       <mac address="fa:16:3e:d0:83:76"/>
Apr 14 06:12:00 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:12:00 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:12:00 user nova-compute[71312]:       <target dev="tap7257f770-94"/>
Apr 14 06:12:00 user nova-compute[71312]:     </interface>
Apr 14 06:12:00 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:12:00 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/216d6140-f106-4928-aa06-bc2d9e860f32/console.log" append="off"/>
Apr 14 06:12:00 user nova-compute[71312]:     </serial>
Apr 14 06:12:00 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:12:00 user nova-compute[71312]:     <video>
Apr 14 06:12:00 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:12:00 user nova-compute[71312]:     </video>
Apr 14 06:12:00 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:12:00 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:12:00 user nova-compute[71312]:     </rng>
Apr 14 06:12:00 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:12:00 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:12:00 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:12:00 user nova-compute[71312]:     </memballoon>
Apr 14 06:12:00 user nova-compute[71312]:   </devices>
Apr 14 06:12:00 user nova-compute[71312]: </domain>
Apr 14 06:12:00 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1934317016',display_name='tempest-ServerActionsTestJSON-server-1934317016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1934317016',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-dk4balnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=216d6140-f106-4928-aa06-bc2d9e860f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:d0:83:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1882208460-network", "vif_mac": "fa:16:3e:d0:83:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG os_vif [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7257f770-94, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7257f770-94, col_values=(('external_ids', {'iface-id': '7257f770-94f7-4c6a-aefd-c1aaeb04af04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:83:76', 'vm-uuid': '216d6140-f106-4928-aa06-bc2d9e860f32'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:00 user nova-compute[71312]: INFO os_vif [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94')
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:12:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] No VIF found with MAC fa:16:3e:d0:83:76, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:12:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 10c629c7-bbc9-4ddc-8284-64017419fada due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452722.1116312, 10c629c7-bbc9-4ddc-8284-64017419fada => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:12:02 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] VM Resumed (Lifecycle Event)
Apr 14 06:12:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance running successfully.
Apr 14 06:12:02 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance soft rebooted successfully.
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:12:02 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452722.1148748, 10c629c7-bbc9-4ddc-8284-64017419fada => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:12:02 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] VM Started (Lifecycle Event)
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.111s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:12:02 user nova-compute[71312]: WARNING nova.compute.manager [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state active and task_state resize_finish.
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:12:02 user nova-compute[71312]: WARNING nova.compute.manager [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state active and task_state None.
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG nova.compute.manager [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:12:02 user nova-compute[71312]: WARNING nova.compute.manager [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state active and task_state None.
Apr 14 06:12:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 216d6140-f106-4928-aa06-bc2d9e860f32 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452724.1565063, 216d6140-f106-4928-aa06-bc2d9e860f32 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:12:04 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] VM Resumed (Lifecycle Event)
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:12:04 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance running successfully.
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Failed to set time: agent not configured {{(pid=71312) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] finish_migration finished successfully. {{(pid=71312) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:12:04 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452724.1598718, 216d6140-f106-4928-aa06-bc2d9e860f32 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:12:04 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] VM Started (Lifecycle Event)
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:12:04 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:12:04 user nova-compute[71312]: DEBUG nova.compute.manager [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:12:04 user nova-compute[71312]: WARNING nova.compute.manager [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state active and task_state resize_finish.
Apr 14 06:12:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:17 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:12:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:12:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:12:21 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:12:21 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:12:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:12:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:12:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8393MB free_disk=26.101757049560547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Applying migration context for instance 216d6140-f106-4928-aa06-bc2d9e860f32 as it has an incoming, in-progress migration a8570d58-616d-473e-bf9a-eb1b0f623e48. Migration status is finished {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 06:12:23 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating resource usage from migration a8570d58-616d-473e-bf9a-eb1b0f623e48
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 10c629c7-bbc9-4ddc-8284-64017419fada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 659408d9-ad86-4482-82dd-710e064e02a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Migration a8570d58-616d-473e-bf9a-eb1b0f623e48 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:12:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:12:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:12:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:12:28 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:12:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:12:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:12:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:12:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:12:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:12:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:12:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:12:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:12:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:12:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:12:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:12:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:12:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:12:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:13:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received event network-changed-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Refreshing instance network info cache due to event network-changed-51eac7c6-f096-473a-90ae-534ed4210867. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] Acquiring lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] Acquired lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:13:05 user nova-compute[71312]: DEBUG nova.network.neutron [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Refreshing network info cache for port 51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:13:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updated VIF entry in instance network info cache for port 51eac7c6-f096-473a-90ae-534ed4210867. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:13:06 user nova-compute[71312]: DEBUG nova.network.neutron [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updating instance_info_cache with network_info: [{"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:13:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] Releasing lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:07 user nova-compute[71312]: INFO nova.compute.manager [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Attaching volume e16793cd-59f8-4d57-a866-11ff27a42949 to /dev/vdb
Apr 14 06:13:07 user nova-compute[71312]: DEBUG os_brick.utils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7555449-cdb7-4942-b51f-27d1d43fa53f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b123a-4f15-4864-a11e-3ec3db0963ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa859540-3469-4e88-8d36-818f55d25091]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5df174-ef15-49a9-b5dd-3b81cbb91ceb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:13:07 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:13:07 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c9970-abe1-42e6-9176-b1954aeb64ab]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG os_brick.utils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:13:07 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updating existing volume attachment record: a0ec9130-4dae-48c5-88e1-e872a3c25264 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:13:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmpQRcwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:13:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:13:12 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:13:12 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[06469f10-06aa-4ffe-8e7c-9e3d705333ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:13:12 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e966661a-0917-4c64-9bac-fb9f14da1d34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949] added
Apr 14 06:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c704de-97c0-47c6-ae6d-dac300bd8356]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9565c7-76d8-47ab-ad51-e28b512a3d0c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmpQRcwP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmpQRcwP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2595f0-fe78-43cf-baa4-6a4d1936db21]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmpQRcwP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e55ad57-930b-49a4-8121-b01d7b01b127]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[551755cb-b877-43b4-af80-aea7f2e19cbc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:13:12 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:13:12 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca180a10-da74-482f-806a-92f321e9f153]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949, portal: 172.16.0.220,3260]
Apr 14 06:13:12 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949, portal: 172.16.0.220,3260] successful.
Apr 14 06:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad1a0c-e187-4f39-bc4a-a204f14c6267]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40a6357-04e0-4846-b1bb-0c98dbb08bf2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:13:12 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:13:12 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)
Apr 14 06:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:13:12 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:13:12 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)
Apr 14 06:13:12 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[474efbdf-1ed5-489a-816f-24ded6bbe26f]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:12 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmpQRcwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23166303237303934', 'path': '/dev/sdd'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166303237303934', 'path': '/dev/sdd'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:13:13 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:13:13 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:13:13 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:13:13 user nova-compute[71312]:   <serial>e16793cd-59f8-4d57-a866-11ff27a42949</serial>
Apr 14 06:13:13 user nova-compute[71312]: </disk>
Apr 14 06:13:13 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:13:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No VIF found with MAC fa:16:3e:c4:4d:03, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:13:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.314s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:13:16 user nova-compute[71312]: INFO nova.compute.claims [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Claim successful on node user
Apr 14 06:13:16 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:13:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.policy [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:13:17 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Creating image(s)
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "/opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "/opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk 1073741824" returned: 0 in 0.057s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Successfully created port: c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Cannot resize image /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'migration_context' on Instance uuid 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Ensure instance console log exists: /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:17 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Successfully updated port: c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquired lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received event network-changed-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Refreshing instance network info cache due to event network-changed-c184c23c-ccfa-48d1-949c-3270c6443649. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] Acquiring lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:13:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Updating instance_info_cache with network_info: [{"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Releasing lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Instance network_info: |[{"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] Acquired lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.network.neutron [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Refreshing network info cache for port c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Start _get_guest_xml network_info=[{"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:13:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:13:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1054773517',display_name='tempest-AttachVolumeNegativeTest-server-1054773517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1054773517',id=39,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1l6C3lS7l3T0Kopj2frWcJGsvadIycSdD9s1243kRogCdFCXq3BLIe3Wh6LAy7Vm3sdaEvM60kvdGVCdwqBRX3H7IMY4npt430N8INv1HPDHGVPw70pQ52Bi7sD9MqUg==',key_name='tempest-keypair-89290876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-wyx3ixaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=0e5cb774-a032-4c16-86a4-e43d6b5d1d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=c184c23c-ccfa-48d1-949c-3270c6443649,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc184c23c-cc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:13:19 user nova-compute[71312]:   <uuid>0e5cb774-a032-4c16-86a4-e43d6b5d1d68</uuid>
Apr 14 06:13:19 user nova-compute[71312]:   <name>instance-00000027</name>
Apr 14 06:13:19 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:13:19 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:13:19 user nova-compute[71312]:   <metadata>
Apr 14 06:13:19 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:13:19 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:13:19 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1054773517</nova:name>
Apr 14 06:13:19 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:13:19</nova:creationTime>
Apr 14 06:13:19 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:13:19 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:13:19 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:13:19 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:13:19 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:13:19 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:13:19 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:13:19 user nova-compute[71312]:       <nova:owner>
Apr 14 06:13:19 user nova-compute[71312]:         <nova:user uuid="6ce33b21c6d541a0a4885680baf52f64">tempest-AttachVolumeNegativeTest-426432803-project-member</nova:user>
Apr 14 06:13:19 user nova-compute[71312]:         <nova:project uuid="86f67a892b9045089159f210e7db3a80">tempest-AttachVolumeNegativeTest-426432803</nova:project>
Apr 14 06:13:19 user nova-compute[71312]:       </nova:owner>
Apr 14 06:13:19 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:13:19 user nova-compute[71312]:       <nova:ports>
Apr 14 06:13:19 user nova-compute[71312]:         <nova:port uuid="c184c23c-ccfa-48d1-949c-3270c6443649">
Apr 14 06:13:19 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 06:13:19 user nova-compute[71312]:         </nova:port>
Apr 14 06:13:19 user nova-compute[71312]:       </nova:ports>
Apr 14 06:13:19 user nova-compute[71312]:     </nova:instance>
Apr 14 06:13:19 user nova-compute[71312]:   </metadata>
Apr 14 06:13:19 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:13:19 user nova-compute[71312]:     <system>
Apr 14 06:13:19 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:13:19 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:13:19 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:13:19 user nova-compute[71312]:       <entry name="serial">0e5cb774-a032-4c16-86a4-e43d6b5d1d68</entry>
Apr 14 06:13:19 user nova-compute[71312]:       <entry name="uuid">0e5cb774-a032-4c16-86a4-e43d6b5d1d68</entry>
Apr 14 06:13:19 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:13:19 user nova-compute[71312]:     </system>
Apr 14 06:13:19 user nova-compute[71312]:   </sysinfo>
Apr 14 06:13:19 user nova-compute[71312]:   <os>
Apr 14 06:13:19 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:13:19 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:13:19 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:13:19 user nova-compute[71312]:   </os>
Apr 14 06:13:19 user nova-compute[71312]:   <features>
Apr 14 06:13:19 user nova-compute[71312]:     <acpi/>
Apr 14 06:13:19 user nova-compute[71312]:     <apic/>
Apr 14 06:13:19 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:13:19 user nova-compute[71312]:   </features>
Apr 14 06:13:19 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:13:19 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:13:19 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:13:19 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:13:19 user nova-compute[71312]:   </clock>
Apr 14 06:13:19 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:13:19 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:13:19 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:13:19 user nova-compute[71312]:   </cpu>
Apr 14 06:13:19 user nova-compute[71312]:   <devices>
Apr 14 06:13:19 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:13:19 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:13:19 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk"/>
Apr 14 06:13:19 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:13:19 user nova-compute[71312]:     </disk>
Apr 14 06:13:19 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:13:19 user nova-compute[71312]:       <mac address="fa:16:3e:f3:eb:d3"/>
Apr 14 06:13:19 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:13:19 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:13:19 user nova-compute[71312]:       <target dev="tapc184c23c-cc"/>
Apr 14 06:13:19 user nova-compute[71312]:     </interface>
Apr 14 06:13:19 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:13:19 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/console.log" append="off"/>
Apr 14 06:13:19 user nova-compute[71312]:     </serial>
Apr 14 06:13:19 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:13:19 user nova-compute[71312]:     <video>
Apr 14 06:13:19 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:13:19 user nova-compute[71312]:     </video>
Apr 14 06:13:19 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:13:19 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:13:19 user nova-compute[71312]:     </rng>
Apr 14 06:13:19 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:13:19 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:13:19 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:13:19 user nova-compute[71312]:     </memballoon>
Apr 14 06:13:19 user nova-compute[71312]:   </devices>
Apr 14 06:13:19 user nova-compute[71312]: </domain>
Apr 14 06:13:19 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1054773517',display_name='tempest-AttachVolumeNegativeTest-server-1054773517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1054773517',id=39,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1l6C3lS7l3T0Kopj2frWcJGsvadIycSdD9s1243kRogCdFCXq3BLIe3Wh6LAy7Vm3sdaEvM60kvdGVCdwqBRX3H7IMY4npt430N8INv1HPDHGVPw70pQ52Bi7sD9MqUg==',key_name='tempest-keypair-89290876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-wyx3ixaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=0e5cb774-a032-4c16-86a4-e43d6b5d1d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=c184c23c-ccfa-48d1-949c-3270c6443649,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc184c23c-cc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG os_vif [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=c184c23c-ccfa-48d1-949c-3270c6443649,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc184c23c-cc') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc184c23c-cc, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc184c23c-cc, col_values=(('external_ids', {'iface-id': 'c184c23c-ccfa-48d1-949c-3270c6443649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:eb:d3', 'vm-uuid': '0e5cb774-a032-4c16-86a4-e43d6b5d1d68'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:19 user nova-compute[71312]: INFO os_vif [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=c184c23c-ccfa-48d1-949c-3270c6443649,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc184c23c-cc')
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No VIF found with MAC fa:16:3e:f3:eb:d3, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.network.neutron [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Updated VIF entry in instance network info cache for port c184c23c-ccfa-48d1-949c-3270c6443649. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG nova.network.neutron [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Updating instance_info_cache with network_info: [{"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] Releasing lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received event network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] Acquiring lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] No waiting events found dispatching network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:13:20 user nova-compute[71312]: WARNING nova.compute.manager [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received unexpected event network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 for instance with vm_state building and task_state spawning.
Apr 14 06:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 594c89a2-66e3-4d1d-8331-60a6aa03c66c {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "216d6140-f106-4928-aa06-bc2d9e860f32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "659408d9-ad86-4482-82dd-710e064e02a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "216d6140-f106-4928-aa06-bc2d9e860f32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "659408d9-ad86-4482-82dd-710e064e02a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452802.6145246, 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:13:22 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] VM Resumed (Lifecycle Event)
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:13:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Instance spawned successfully.
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:13:22 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681452802.6193423, 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:13:22 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] VM Started (Lifecycle Event)
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:13:22 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:22 user nova-compute[71312]: INFO nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:13:22 user nova-compute[71312]: INFO nova.compute.manager [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Took 6.20 seconds to build instance.
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received event network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] Acquiring lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] No waiting events found dispatching network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:13:22 user nova-compute[71312]: WARNING nova.compute.manager [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received unexpected event network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 for instance with vm_state active and task_state None.
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.331s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.970s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:22 user nova-compute[71312]: INFO nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:13:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:24 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:13:24 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8436MB free_disk=26.09955596923828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Applying migration context for instance 216d6140-f106-4928-aa06-bc2d9e860f32 as it has an incoming, in-progress migration a8570d58-616d-473e-bf9a-eb1b0f623e48. Migration status is finished {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 06:13:24 user nova-compute[71312]: INFO nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating resource usage from migration a8570d58-616d-473e-bf9a-eb1b0f623e48
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 10c629c7-bbc9-4ddc-8284-64017419fada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 659408d9-ad86-4482-82dd-710e064e02a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Migration a8570d58-616d-473e-bf9a-eb1b0f623e48 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:13:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:30 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:13:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:13:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:13:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating instance_info_cache with network_info: [{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:13:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:13:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:13:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:13:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:13:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:13:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Going to confirm migration 2 {{(pid=71312) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquired lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'info_cache' on Instance uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating instance_info_cache with network_info: [{"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Releasing lock "refresh_cache-216d6140-f106-4928-aa06-bc2d9e860f32" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'migration_context' on Instance uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:13:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.279s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:41 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Deleted allocation for migration a8570d58-616d-473e-bf9a-eb1b0f623e48
Apr 14 06:13:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.126s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:13:46 user nova-compute[71312]: DEBUG nova.compute.manager [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing instance network info cache due to event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:13:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] Acquiring lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:13:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] Acquired lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:13:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:13:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updated VIF entry in instance network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:13:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:13:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] Releasing lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing instance network info cache due to event network-changed-e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] Acquiring lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] Acquired lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Refreshing network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:13:47 user nova-compute[71312]: INFO nova.compute.manager [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Detaching volume 1fa1963a-1093-4d62-9995-c005329e90ca
Apr 14 06:13:47 user nova-compute[71312]: INFO nova.virt.block_device [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Attempting to driver detach volume 1fa1963a-1093-4d62-9995-c005329e90ca from mountpoint /dev/vdb
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Attempting to detach device vdb from instance 10c629c7-bbc9-4ddc-8284-64017419fada from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:13:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:13:47 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:13:47 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:13:47 user nova-compute[71312]:   <serial>1fa1963a-1093-4d62-9995-c005329e90ca</serial>
Apr 14 06:13:47 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:13:47 user nova-compute[71312]: </disk>
Apr 14 06:13:47 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:13:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully detached device vdb from instance 10c629c7-bbc9-4ddc-8284-64017419fada from the persistent domain config.
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 10c629c7-bbc9-4ddc-8284-64017419fada from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:13:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:13:47 user nova-compute[71312]:   <source dev="/dev/sdc"/>
Apr 14 06:13:47 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:13:47 user nova-compute[71312]:   <serial>1fa1963a-1093-4d62-9995-c005329e90ca</serial>
Apr 14 06:13:47 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:13:47 user nova-compute[71312]: </disk>
Apr 14 06:13:47 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updated VIF entry in instance network info cache for port e9e38732-b365-4366-9985-4bd8392b49a2. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [{"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] Releasing lock "refresh_cache-10c629c7-bbc9-4ddc-8284-64017419fada" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452827.8110976, 10c629c7-bbc9-4ddc-8284-64017419fada => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:13:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully detached device vdb from instance 10c629c7-bbc9-4ddc-8284-64017419fada from the live domain config.
Apr 14 06:13:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJGpScIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:13:47 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba83a1b-fb64-4a53-8fe1-23d1db189481]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:13:47 user nova-compute[71312]: No targets found.
Apr 14 06:13:47 user nova-compute[71312]: iSNS:
Apr 14 06:13:47 user nova-compute[71312]: No targets found.
Apr 14 06:13:47 user nova-compute[71312]: STATIC:
Apr 14 06:13:47 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949
Apr 14 06:13:47 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:13:47 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:13:47 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca
Apr 14 06:13:47 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:13:47 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:13:47 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b
Apr 14 06:13:47 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:13:47 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:13:47 user nova-compute[71312]: FIRMWARE:
Apr 14 06:13:47 user nova-compute[71312]: No targets found.
Apr 14 06:13:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:13:47 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:13:47 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7ce264-5f58-422b-a1d6-acb91e139999]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f01b817-66f4-49d7-854c-e09629c47229]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:13:47 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:13:47 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)
Apr 14 06:13:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca (non-flash)
Apr 14 06:13:47 user nova-compute[71312]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:13:47 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)
Apr 14 06:13:47 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49a4539c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca'): ({'sdc'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Removing single pathed devices sdc {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4603ef9e-c6bd-4290-8caf-e6f2df0a9026]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5d7b4a-da72-48f1-99dd-88549583ed46]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flushing IO for device /dev/sdc {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6458caa-61ce-42c2-975f-80cad3cc38ac]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:13:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64be3443-e87e-456e-b5a6-69b7ecdde7dc]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] SCSI volumes sdc have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87456a2-5164-4355-9e14-9282e1f1a641]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e361d6c-cdeb-4b04-a4b8-6efe6c49c984]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca, portal: 172.16.0.220,3260]
Apr 14 06:13:48 user nova-compute[71312]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca, portal: 172.16.0.220,3260] successful.
Apr 14 06:13:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa1963a-1093-4d62-9995-c005329e90ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c77b9b-f773-458b-91cb-858400134aba]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] <== disconnect_volume: return (324ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG nova.objects.instance [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'flavor' on Instance uuid 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:13:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.732s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:13:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:13:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:14:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:14:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:14:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:19 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:14:24 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:14:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:14:26 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:14:26 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8410MB free_disk=26.079010009765625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 10c629c7-bbc9-4ddc-8284-64017419fada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 659408d9-ad86-4482-82dd-710e064e02a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:14:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:14:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:14:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:14:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updating instance_info_cache with network_info: [{"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:14:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:14:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:14:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:14:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:41 user nova-compute[71312]: INFO nova.compute.manager [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Terminating instance
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-unplugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-unplugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-unplugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Instance destroyed successfully.
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'resources' on Instance uuid 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-490473571',display_name='tempest-TestMinimumBasicScenario-server-490473571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-490473571',id=36,image_ref='2b01c0ae-81f1-467e-b60a-a042f9451f03',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6717EzUGPxpTDGefgn7rftigYth+LN1b3MDw9UEhO4TFyX7K4H3Y2IEbim4etXBQkV03TLTzHm/4DHGPKSs7S1l1Q1oGMK8FZaaRruTC6RsXI+5MtzYR1tXUiaq7CGuQ==',key_name='tempest-TestMinimumBasicScenario-837934314',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:09:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a4e84122c3c4cb68c55043fd3c4db35',ramdisk_id='',reservation_id='r-kj9ys0el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2b01c0ae-81f1-467e-b60a-a042f9451f03',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-17585386',owner_user_name='tempest-TestMinimumBasicScenario-17585386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:12:02Z,user_data=None,user_id='b59b8f9b395149c7a2eef067766f0935',uuid=10c629c7-bbc9-4ddc-8284-64017419fada,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converting VIF {"id": "e9e38732-b365-4366-9985-4bd8392b49a2", "address": "fa:16:3e:b4:86:43", "network": {"id": "bbe6141e-3cce-47df-aec9-bf81eb18830c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1956078648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4e84122c3c4cb68c55043fd3c4db35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9e38732-b3", "ovs_interfaceid": "e9e38732-b365-4366-9985-4bd8392b49a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:86:43,bridge_name='br-int',has_traffic_filtering=True,id=e9e38732-b365-4366-9985-4bd8392b49a2,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e38732-b3') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG os_vif [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:86:43,bridge_name='br-int',has_traffic_filtering=True,id=e9e38732-b365-4366-9985-4bd8392b49a2,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e38732-b3') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9e38732-b3, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:14:41 user nova-compute[71312]: INFO os_vif [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:86:43,bridge_name='br-int',has_traffic_filtering=True,id=e9e38732-b365-4366-9985-4bd8392b49a2,network=Network(bbe6141e-3cce-47df-aec9-bf81eb18830c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9e38732-b3')
Apr 14 06:14:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Deleting instance files /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada_del
Apr 14 06:14:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Deletion of /opt/stack/data/nova/instances/10c629c7-bbc9-4ddc-8284-64017419fada_del complete
Apr 14 06:14:41 user nova-compute[71312]: INFO nova.compute.manager [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 06:14:41 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:14:41 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:42 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:14:42 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Took 1.05 seconds to deallocate network for instance.
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:43 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Deleted allocations for instance 10c629c7-bbc9-4ddc-8284-64017419fada
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:14:43 user nova-compute[71312]: WARNING nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state deleted and task_state None.
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:14:43 user nova-compute[71312]: WARNING nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state deleted and task_state None.
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:14:43 user nova-compute[71312]: WARNING nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state deleted and task_state None.
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Acquiring lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "10c629c7-bbc9-4ddc-8284-64017419fada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] No waiting events found dispatching network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:14:43 user nova-compute[71312]: WARNING nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received unexpected event network-vif-plugged-e9e38732-b365-4366-9985-4bd8392b49a2 for instance with vm_state deleted and task_state None.
Apr 14 06:14:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Received event network-vif-deleted-e9e38732-b365-4366-9985-4bd8392b49a2 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:14:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "10c629c7-bbc9-4ddc-8284-64017419fada" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.371s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:14:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:14:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:14:56 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452881.820701, 10c629c7-bbc9-4ddc-8284-64017419fada => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:14:56 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] VM Stopped (Lifecycle Event)
Apr 14 06:14:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4d4f0166-0f3f-4c86-bb26-54108bd71e0d None None] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:14:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:15:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received event network-changed-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Refreshing instance network info cache due to event network-changed-c184c23c-ccfa-48d1-949c-3270c6443649. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] Acquiring lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] Acquired lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Refreshing network info cache for port c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:15:07 user nova-compute[71312]: INFO nova.compute.manager [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Terminating instance
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Updated VIF entry in instance network info cache for port c184c23c-ccfa-48d1-949c-3270c6443649. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.network.neutron [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Updating instance_info_cache with network_info: [{"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] Releasing lock "refresh_cache-0e5cb774-a032-4c16-86a4-e43d6b5d1d68" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received event network-vif-unplugged-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] Acquiring lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] No waiting events found dispatching network-vif-unplugged-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:15:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received event network-vif-unplugged-c184c23c-ccfa-48d1-949c-3270c6443649 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Instance destroyed successfully.
Apr 14 06:15:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'resources' on Instance uuid 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1054773517',display_name='tempest-AttachVolumeNegativeTest-server-1054773517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1054773517',id=39,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1l6C3lS7l3T0Kopj2frWcJGsvadIycSdD9s1243kRogCdFCXq3BLIe3Wh6LAy7Vm3sdaEvM60kvdGVCdwqBRX3H7IMY4npt430N8INv1HPDHGVPw70pQ52Bi7sD9MqUg==',key_name='tempest-keypair-89290876',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-wyx3ixaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=0e5cb774-a032-4c16-86a4-e43d6b5d1d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "c184c23c-ccfa-48d1-949c-3270c6443649", "address": "fa:16:3e:f3:eb:d3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc184c23c-cc", "ovs_interfaceid": "c184c23c-ccfa-48d1-949c-3270c6443649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=c184c23c-ccfa-48d1-949c-3270c6443649,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc184c23c-cc') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG os_vif [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=c184c23c-ccfa-48d1-949c-3270c6443649,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc184c23c-cc') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc184c23c-cc, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:08 user nova-compute[71312]: INFO os_vif [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:eb:d3,bridge_name='br-int',has_traffic_filtering=True,id=c184c23c-ccfa-48d1-949c-3270c6443649,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc184c23c-cc')
Apr 14 06:15:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Deleting instance files /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68_del
Apr 14 06:15:08 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Deletion of /opt/stack/data/nova/instances/0e5cb774-a032-4c16-86a4-e43d6b5d1d68_del complete
Apr 14 06:15:08 user nova-compute[71312]: INFO nova.compute.manager [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 14 06:15:08 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:15:08 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:15:09 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:15:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received event network-vif-deleted-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:15:09 user nova-compute[71312]: INFO nova.compute.manager [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Neutron deleted interface c184c23c-ccfa-48d1-949c-3270c6443649; detaching it from the instance and deleting it from the info cache
Apr 14 06:15:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:15:09 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Took 0.72 seconds to deallocate network for instance.
Apr 14 06:15:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Detach interface failed, port_id=c184c23c-ccfa-48d1-949c-3270c6443649, reason: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 06:15:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:15:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:15:09 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:15:09 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:15:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:15:09 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Deleted allocations for instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68
Apr 14 06:15:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.729s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:15:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received event network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:15:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] Acquiring lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:15:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:15:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] Lock "0e5cb774-a032-4c16-86a4-e43d6b5d1d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:15:10 user nova-compute[71312]: DEBUG nova.compute.manager [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] No waiting events found dispatching network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:15:10 user nova-compute[71312]: WARNING nova.compute.manager [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Received unexpected event network-vif-plugged-c184c23c-ccfa-48d1-949c-3270c6443649 for instance with vm_state deleted and task_state None.
Apr 14 06:15:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:23 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452908.2576504, 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:15:23 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] VM Stopped (Lifecycle Event)
Apr 14 06:15:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-407a0778-55d1-4868-a44e-9616d1882973 None None] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:15:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:15:26 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:26 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:15:27 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:15:27 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:15:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=26.117523193359375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 659408d9-ad86-4482-82dd-710e064e02a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:15:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:15:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:15:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:15:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:15:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:15:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:30 user nova-compute[71312]: INFO nova.compute.manager [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Get console output
Apr 14 06:15:30 user nova-compute[71312]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 06:15:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:15:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 594c89a2-66e3-4d1d-8331-60a6aa03c66c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:15:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:33 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updating instance_info_cache with network_info: [{"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:15:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-594c89a2-66e3-4d1d-8331-60a6aa03c66c" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:15:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:15:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:15:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:15:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:15:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:15:58 user nova-compute[71312]: INFO nova.compute.manager [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Detaching volume e16793cd-59f8-4d57-a866-11ff27a42949
Apr 14 06:15:58 user nova-compute[71312]: INFO nova.virt.block_device [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Attempting to driver detach volume e16793cd-59f8-4d57-a866-11ff27a42949 from mountpoint /dev/vdb
Apr 14 06:15:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Attempting to detach device vdb from instance 659408d9-ad86-4482-82dd-710e064e02a1 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:15:58 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:15:58 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:15:58 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:15:58 user nova-compute[71312]:   <serial>e16793cd-59f8-4d57-a866-11ff27a42949</serial>
Apr 14 06:15:58 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:15:58 user nova-compute[71312]: </disk>
Apr 14 06:15:58 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:15:58 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully detached device vdb from instance 659408d9-ad86-4482-82dd-710e064e02a1 from the persistent domain config.
Apr 14 06:15:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 659408d9-ad86-4482-82dd-710e064e02a1 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:15:58 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:15:58 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:15:58 user nova-compute[71312]:   <source dev="/dev/sdd"/>
Apr 14 06:15:58 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:15:58 user nova-compute[71312]:   <serial>e16793cd-59f8-4d57-a866-11ff27a42949</serial>
Apr 14 06:15:58 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:15:58 user nova-compute[71312]: </disk>
Apr 14 06:15:58 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681452959.4481332, 659408d9-ad86-4482-82dd-710e064e02a1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:15:59 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully detached device vdb from instance 659408d9-ad86-4482-82dd-710e064e02a1 from the live domain config.
Apr 14 06:15:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmpQRcwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:15:59 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5a5392-103a-480e-bfc5-8b77d5c2305c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:15:59 user nova-compute[71312]: No targets found.
Apr 14 06:15:59 user nova-compute[71312]: iSNS:
Apr 14 06:15:59 user nova-compute[71312]: No targets found.
Apr 14 06:15:59 user nova-compute[71312]: STATIC:
Apr 14 06:15:59 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949
Apr 14 06:15:59 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:15:59 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:15:59 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b
Apr 14 06:15:59 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:15:59 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:15:59 user nova-compute[71312]: FIRMWARE:
Apr 14 06:15:59 user nova-compute[71312]: No targets found.
Apr 14 06:15:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:15:59 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:15:59 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9967e165-84d5-44c0-b98c-09ca58984125]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017ffa0-e4ef-4227-8cc5-0cca15b3b13f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:15:59 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)
Apr 14 06:15:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:15:59 user nova-compute[71312]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 (non-flash)
Apr 14 06:15:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc2111b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949'): ({'sdd'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Removing single pathed devices sdd {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdc560d-aa66-4c01-adba-f2aa8e3e102b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ce5e92-14a1-44d1-85e8-bd08b9672976]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flushing IO for device /dev/sdd {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebb3191-6c66-4c24-ae5b-b4515cf9dbe8]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e935867-e7f2-48b3-acf5-908614187677]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] SCSI volumes sdd have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e82aa-5564-439e-ae1c-9f775bfbd695]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001eff1-061f-4cbc-b1ab-034b813274b5]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949, portal: 172.16.0.220,3260]
Apr 14 06:15:59 user nova-compute[71312]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949, portal: 172.16.0.220,3260] successful.
Apr 14 06:15:59 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16793cd-59f8-4d57-a866-11ff27a42949 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6889384b-052d-470d-9135-6c701ff1a1e9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== disconnect_volume: return (308ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:15:59 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:16:00 user nova-compute[71312]: DEBUG nova.objects.instance [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:16:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.730s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:16:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:16:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:20 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:16:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:16:28 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:16:28 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:16:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=26.138744354248047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 659408d9-ad86-4482-82dd-710e064e02a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:16:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:16:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:16:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:16:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:16:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:31 user nova-compute[71312]: INFO nova.compute.manager [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Terminating instance
Apr 14 06:16:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Instance destroyed successfully.
Apr 14 06:16:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'resources' on Instance uuid 216d6140-f106-4928-aa06-bc2d9e860f32 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1934317016',display_name='tempest-ServerActionsTestJSON-server-1934317016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1934317016',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:12:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-dk4balnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=216d6140-f106-4928-aa06-bc2d9e860f32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "address": "fa:16:3e:d0:83:76", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7257f770-94", "ovs_interfaceid": "7257f770-94f7-4c6a-aefd-c1aaeb04af04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_vif [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7257f770-94, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:16:32 user nova-compute[71312]: INFO os_vif [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:83:76,bridge_name='br-int',has_traffic_filtering=True,id=7257f770-94f7-4c6a-aefd-c1aaeb04af04,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7257f770-94')
Apr 14 06:16:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQwtsKIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:16:32 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ea2fb1-b165-44a7-9160-95242acec911]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:16:32 user nova-compute[71312]: No targets found.
Apr 14 06:16:32 user nova-compute[71312]: iSNS:
Apr 14 06:16:32 user nova-compute[71312]: No targets found.
Apr 14 06:16:32 user nova-compute[71312]: STATIC:
Apr 14 06:16:32 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b
Apr 14 06:16:32 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:16:32 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:16:32 user nova-compute[71312]: FIRMWARE:
Apr 14 06:16:32 user nova-compute[71312]: No targets found.
Apr 14 06:16:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:16:32 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:16:32 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518fc4c-deb6-4e6c-8175-c030338d1acb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6126c1a-ae1d-4de1-8292-aa6d0a5bfee9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:16:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b (non-flash)
Apr 14 06:16:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49a45b8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be3de5-358b-4eb1-99f0-349909be784d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a268d39-60bd-40c0-b0ac-0c59f56a8a5b]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c30439-040d-4d75-97df-a2e0e232f7de]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0067065-49ba-439c-93ee-ea04ebe70d2c]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23265356138393936', '/dev/disk/by-id/scsi-1SCST_BIO3c6ddbc5-2e5a8996dbfe600e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c6ddbc5') {{(pid=81359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c523018b-337b-45b6-866b-70aaea679abc]: (4, None) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a32992-d63c-4e25-accf-dfcb25f9dfb4]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9cf2e5-ba72-4e2f-955b-417102a90560]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260]
Apr 14 06:16:32 user nova-compute[71312]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b, portal: 172.16.0.220,3260] successful.
Apr 14 06:16:32 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98f1b81-0e6e-43f4-ae89-22875745113b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e217c3-e168-44cb-9d79-d88f2049eccb]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] <== disconnect_volume: return (335ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:16:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Deleting instance files /opt/stack/data/nova/instances/216d6140-f106-4928-aa06-bc2d9e860f32_del
Apr 14 06:16:32 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Deletion of /opt/stack/data/nova/instances/216d6140-f106-4928-aa06-bc2d9e860f32_del complete
Apr 14 06:16:32 user nova-compute[71312]: INFO nova.compute.manager [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:16:33 user nova-compute[71312]: WARNING nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state active and task_state deleting.
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:16:33 user nova-compute[71312]: WARNING nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state active and task_state deleting.
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:16:33 user nova-compute[71312]: WARNING nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state active and task_state deleting.
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-unplugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Acquiring lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "216d6140-f106-4928-aa06-bc2d9e860f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] No waiting events found dispatching network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:16:33 user nova-compute[71312]: WARNING nova.compute.manager [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received unexpected event network-vif-plugged-7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance with vm_state active and task_state deleting.
Apr 14 06:16:33 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:16:33 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Took 1.37 seconds to deallocate network for instance.
Apr 14 06:16:34 user nova-compute[71312]: DEBUG nova.compute.manager [req-dee14749-fd86-4fed-beef-8203b07acfa4 req-56d79194-fa89-4c46-9c94-370561943511 service nova] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Received event network-vif-deleted-7257f770-94f7-4c6a-aefd-c1aaeb04af04 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:16:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Skipping network cache update for instance because it is being deleted. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 14 06:16:34 user nova-compute[71312]: INFO nova.compute.manager [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Took 0.79 seconds to detach 1 volumes for instance.
Apr 14 06:16:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Deleting volume: e98f1b81-0e6e-43f4-ae89-22875745113b {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 06:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:16:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:35 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:16:35 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:35 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Deleted allocations for instance 216d6140-f106-4928-aa06-bc2d9e860f32
Apr 14 06:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "216d6140-f106-4928-aa06-bc2d9e860f32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.879s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updating instance_info_cache with network_info: [{"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:16:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-659408d9-ad86-4482-82dd-710e064e02a1" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:16:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:16:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:16:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:16:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:16:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:16:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:16:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:16:47 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681452992.1607568, 216d6140-f106-4928-aa06-bc2d9e860f32 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:16:47 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] VM Stopped (Lifecycle Event)
Apr 14 06:16:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6416db5f-423c-4588-acbb-cd2927e1bc1c None None] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:16:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:49 user nova-compute[71312]: INFO nova.compute.manager [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Terminating instance
Apr 14 06:16:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received event network-vif-unplugged-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] No waiting events found dispatching network-vif-unplugged-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:16:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received event network-vif-unplugged-51eac7c6-f096-473a-90ae-534ed4210867 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:16:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Instance destroyed successfully.
Apr 14 06:16:50 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'resources' on Instance uuid 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2028846765',display_name='tempest-AttachVolumeNegativeTest-server-2028846765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2028846765',id=38,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6TF+Zg8ftP47ylXb1K6XxWAu4TjAIiWKAEJPZubTTV6Po1otD7NtEzR0XXRZ+xy6RMchrhrvyJqfpCw1RQiMKvQ71lI2KS+6GWglZOJBgoHB+VsSVOJvbvbgum5X9zjQ==',key_name='tempest-keypair-1140459230',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-jxg5o2ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=659408d9-ad86-4482-82dd-710e064e02a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "51eac7c6-f096-473a-90ae-534ed4210867", "address": "fa:16:3e:c4:4d:03", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51eac7c6-f0", "ovs_interfaceid": "51eac7c6-f096-473a-90ae-534ed4210867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=51eac7c6-f096-473a-90ae-534ed4210867,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51eac7c6-f0') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG os_vif [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=51eac7c6-f096-473a-90ae-534ed4210867,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51eac7c6-f0') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51eac7c6-f0, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:16:50 user nova-compute[71312]: INFO os_vif [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=51eac7c6-f096-473a-90ae-534ed4210867,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51eac7c6-f0')
Apr 14 06:16:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Deleting instance files /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1_del
Apr 14 06:16:50 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Deletion of /opt/stack/data/nova/instances/659408d9-ad86-4482-82dd-710e064e02a1_del complete
Apr 14 06:16:50 user nova-compute[71312]: INFO nova.compute.manager [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 06:16:50 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:16:50 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:16:51 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Took 0.82 seconds to deallocate network for instance.
Apr 14 06:16:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:51 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Deleted allocations for instance 659408d9-ad86-4482-82dd-710e064e02a1
Apr 14 06:16:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "659408d9-ad86-4482-82dd-710e064e02a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received event network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Acquiring lock "659408d9-ad86-4482-82dd-710e064e02a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Lock "659408d9-ad86-4482-82dd-710e064e02a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:16:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] No waiting events found dispatching network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:16:51 user nova-compute[71312]: WARNING nova.compute.manager [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received unexpected event network-vif-plugged-51eac7c6-f096-473a-90ae-534ed4210867 for instance with vm_state deleted and task_state None.
Apr 14 06:16:51 user nova-compute[71312]: DEBUG nova.compute.manager [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Received event network-vif-deleted-51eac7c6-f096-473a-90ae-534ed4210867 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:16:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:17:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:05 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681453010.250228, 659408d9-ad86-4482-82dd-710e064e02a1 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:17:05 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] VM Stopped (Lifecycle Event)
Apr 14 06:17:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-023abef9-4437-4556-9f41-3f360add4834 None None] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:17:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:17:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:17:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:17:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:22 user nova-compute[71312]: INFO nova.compute.manager [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Terminating instance
Apr 14 06:17:22 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-unplugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] No waiting events found dispatching network-vif-unplugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-unplugged-1368a896-f16c-4222-9542-c591daa2e361 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Instance destroyed successfully.
Apr 14 06:17:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'resources' on Instance uuid 594c89a2-66e3-4d1d-8331-60a6aa03c66c {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1316450739',display_name='tempest-ServerActionsTestJSON-server-1316450739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1316450739',id=35,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A==',key_name='tempest-keypair-1592565508',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc4321a7868464faa59341018ed747f',ramdisk_id='',reservation_id='r-90hibjyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-31064769',owner_user_name='tempest-ServerActionsTestJSON-31064769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='290b67b22a91443fbfc829fa4e3db036',uuid=594c89a2-66e3-4d1d-8331-60a6aa03c66c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converting VIF {"id": "1368a896-f16c-4222-9542-c591daa2e361", "address": "fa:16:3e:0f:af:b5", "network": {"id": "120654f0-7376-4b69-9763-9e1631a23590", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1882208460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc4321a7868464faa59341018ed747f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1368a896-f1", "ovs_interfaceid": "1368a896-f16c-4222-9542-c591daa2e361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=1368a896-f16c-4222-9542-c591daa2e361,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1368a896-f1') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG os_vif [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=1368a896-f16c-4222-9542-c591daa2e361,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1368a896-f1') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1368a896-f1, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:22 user nova-compute[71312]: INFO os_vif [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=1368a896-f16c-4222-9542-c591daa2e361,network=Network(120654f0-7376-4b69-9763-9e1631a23590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1368a896-f1')
Apr 14 06:17:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Deleting instance files /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c_del
Apr 14 06:17:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Deletion of /opt/stack/data/nova/instances/594c89a2-66e3-4d1d-8331-60a6aa03c66c_del complete
Apr 14 06:17:23 user nova-compute[71312]: INFO nova.compute.manager [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 06:17:23 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:17:23 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Took 0.60 seconds to deallocate network for instance.
Apr 14 06:17:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-f4bb0b0c-4a4d-4ac6-94b8-8f0308effd7b req-e4181b97-7d3d-4beb-8575-ebfd0966ea3c service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-deleted-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:17:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:23 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Deleted allocations for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.853s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] No waiting events found dispatching network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:17:24 user nova-compute[71312]: WARNING nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received unexpected event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 for instance with vm_state deleted and task_state None.
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] No waiting events found dispatching network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:17:24 user nova-compute[71312]: WARNING nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received unexpected event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 for instance with vm_state deleted and task_state None.
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] No waiting events found dispatching network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:17:24 user nova-compute[71312]: WARNING nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received unexpected event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 for instance with vm_state deleted and task_state None.
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-unplugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] No waiting events found dispatching network-vif-unplugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:17:24 user nova-compute[71312]: WARNING nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received unexpected event network-vif-unplugged-1368a896-f16c-4222-9542-c591daa2e361 for instance with vm_state deleted and task_state None.
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Acquiring lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "594c89a2-66e3-4d1d-8331-60a6aa03c66c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] No waiting events found dispatching network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:17:24 user nova-compute[71312]: WARNING nova.compute.manager [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Received unexpected event network-vif-plugged-1368a896-f16c-4222-9542-c591daa2e361 for instance with vm_state deleted and task_state None.
Apr 14 06:17:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:27 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:28 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:17:28 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:17:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=26.176776885986328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:17:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:17:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:17:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:17:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:17:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:17:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:17:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:37 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681453042.9290376, 594c89a2-66e3-4d1d-8331-60a6aa03c66c => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:17:37 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] VM Stopped (Lifecycle Event)
Apr 14 06:17:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-29a7511f-0924-45d9-9300-498d0bc5b441 None None] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:17:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:17:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:17:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:17:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:43 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:17:43 user nova-compute[71312]: INFO nova.compute.claims [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Claim successful on node user
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:17:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.policy [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:17:44 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Creating image(s)
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "/opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "/opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "/opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk 1073741824" returned: 0 in 0.055s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Cannot resize image /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'migration_context' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Ensure instance console log exists: /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Successfully created port: 7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Successfully updated port: 7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquired lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received event network-changed-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG nova.compute.manager [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Refreshing instance network info cache due to event network-changed-7bca777d-f535-4686-8b83-bb2d216cb909. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] Acquiring lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:17:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updating instance_info_cache with network_info: [{"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Releasing lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Instance network_info: |[{"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] Acquired lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Refreshing network info cache for port 7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Start _get_guest_xml network_info=[{"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:17:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:17:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-859725183',display_name='tempest-AttachVolumeNegativeTest-server-859725183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-859725183',id=40,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHl9rjESEyj/xQy1K6phJqwsUzo/nEYL//jJfu5dMId2YL4VarlPegLgYPQgivwb2Wqs9qt4pL/mOlAlpvvQXPcmK6ZzLy9k8NgQpR8zO8LRfwfDcZ7lzSso7PTHYh8G8g==',key_name='tempest-keypair-1767081454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-4kll0lno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=aed587e2-a592-4241-9088-d15c4856f6f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=7bca777d-f535-4686-8b83-bb2d216cb909,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bca777d-f5') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'pci_devices' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:17:46 user nova-compute[71312]:   <uuid>aed587e2-a592-4241-9088-d15c4856f6f8</uuid>
Apr 14 06:17:46 user nova-compute[71312]:   <name>instance-00000028</name>
Apr 14 06:17:46 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:17:46 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:17:46 user nova-compute[71312]:   <metadata>
Apr 14 06:17:46 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:17:46 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:17:46 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeNegativeTest-server-859725183</nova:name>
Apr 14 06:17:46 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:17:46</nova:creationTime>
Apr 14 06:17:46 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:17:46 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:17:46 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:17:46 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:17:46 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:17:46 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:17:46 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:17:46 user nova-compute[71312]:       <nova:owner>
Apr 14 06:17:46 user nova-compute[71312]:         <nova:user uuid="6ce33b21c6d541a0a4885680baf52f64">tempest-AttachVolumeNegativeTest-426432803-project-member</nova:user>
Apr 14 06:17:46 user nova-compute[71312]:         <nova:project uuid="86f67a892b9045089159f210e7db3a80">tempest-AttachVolumeNegativeTest-426432803</nova:project>
Apr 14 06:17:46 user nova-compute[71312]:       </nova:owner>
Apr 14 06:17:46 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:17:46 user nova-compute[71312]:       <nova:ports>
Apr 14 06:17:46 user nova-compute[71312]:         <nova:port uuid="7bca777d-f535-4686-8b83-bb2d216cb909">
Apr 14 06:17:46 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 06:17:46 user nova-compute[71312]:         </nova:port>
Apr 14 06:17:46 user nova-compute[71312]:       </nova:ports>
Apr 14 06:17:46 user nova-compute[71312]:     </nova:instance>
Apr 14 06:17:46 user nova-compute[71312]:   </metadata>
Apr 14 06:17:46 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:17:46 user nova-compute[71312]:     <system>
Apr 14 06:17:46 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:17:46 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:17:46 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:17:46 user nova-compute[71312]:       <entry name="serial">aed587e2-a592-4241-9088-d15c4856f6f8</entry>
Apr 14 06:17:46 user nova-compute[71312]:       <entry name="uuid">aed587e2-a592-4241-9088-d15c4856f6f8</entry>
Apr 14 06:17:46 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:17:46 user nova-compute[71312]:     </system>
Apr 14 06:17:46 user nova-compute[71312]:   </sysinfo>
Apr 14 06:17:46 user nova-compute[71312]:   <os>
Apr 14 06:17:46 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:17:46 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:17:46 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:17:46 user nova-compute[71312]:   </os>
Apr 14 06:17:46 user nova-compute[71312]:   <features>
Apr 14 06:17:46 user nova-compute[71312]:     <acpi/>
Apr 14 06:17:46 user nova-compute[71312]:     <apic/>
Apr 14 06:17:46 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:17:46 user nova-compute[71312]:   </features>
Apr 14 06:17:46 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:17:46 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:17:46 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:17:46 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:17:46 user nova-compute[71312]:   </clock>
Apr 14 06:17:46 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:17:46 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:17:46 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:17:46 user nova-compute[71312]:   </cpu>
Apr 14 06:17:46 user nova-compute[71312]:   <devices>
Apr 14 06:17:46 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:17:46 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:17:46 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk"/>
Apr 14 06:17:46 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:17:46 user nova-compute[71312]:     </disk>
Apr 14 06:17:46 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:17:46 user nova-compute[71312]:       <mac address="fa:16:3e:38:3f:c3"/>
Apr 14 06:17:46 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:17:46 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:17:46 user nova-compute[71312]:       <target dev="tap7bca777d-f5"/>
Apr 14 06:17:46 user nova-compute[71312]:     </interface>
Apr 14 06:17:46 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:17:46 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/console.log" append="off"/>
Apr 14 06:17:46 user nova-compute[71312]:     </serial>
Apr 14 06:17:46 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:17:46 user nova-compute[71312]:     <video>
Apr 14 06:17:46 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:17:46 user nova-compute[71312]:     </video>
Apr 14 06:17:46 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:17:46 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:17:46 user nova-compute[71312]:     </rng>
Apr 14 06:17:46 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:17:46 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:17:46 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:17:46 user nova-compute[71312]:     </memballoon>
Apr 14 06:17:46 user nova-compute[71312]:   </devices>
Apr 14 06:17:46 user nova-compute[71312]: </domain>
Apr 14 06:17:46 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-859725183',display_name='tempest-AttachVolumeNegativeTest-server-859725183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-859725183',id=40,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHl9rjESEyj/xQy1K6phJqwsUzo/nEYL//jJfu5dMId2YL4VarlPegLgYPQgivwb2Wqs9qt4pL/mOlAlpvvQXPcmK6ZzLy9k8NgQpR8zO8LRfwfDcZ7lzSso7PTHYh8G8g==',key_name='tempest-keypair-1767081454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-4kll0lno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=aed587e2-a592-4241-9088-d15c4856f6f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=7bca777d-f535-4686-8b83-bb2d216cb909,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bca777d-f5') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG os_vif [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=7bca777d-f535-4686-8b83-bb2d216cb909,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bca777d-f5') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bca777d-f5, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bca777d-f5, col_values=(('external_ids', {'iface-id': '7bca777d-f535-4686-8b83-bb2d216cb909', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:3f:c3', 'vm-uuid': 'aed587e2-a592-4241-9088-d15c4856f6f8'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:46 user nova-compute[71312]: INFO os_vif [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=7bca777d-f535-4686-8b83-bb2d216cb909,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bca777d-f5')
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No VIF found with MAC fa:16:3e:38:3f:c3, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updated VIF entry in instance network info cache for port 7bca777d-f535-4686-8b83-bb2d216cb909. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG nova.network.neutron [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updating instance_info_cache with network_info: [{"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:17:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] Releasing lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:17:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received event network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] No waiting events found dispatching network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:17:47 user nova-compute[71312]: WARNING nova.compute.manager [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received unexpected event network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 for instance with vm_state building and task_state spawning.
Apr 14 06:17:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453069.6217022, aed587e2-a592-4241-9088-d15c4856f6f8 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:17:49 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] VM Resumed (Lifecycle Event)
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:17:49 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Instance spawned successfully.
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:17:49 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453069.6237798, aed587e2-a592-4241-9088-d15c4856f6f8 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:17:49 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] VM Started (Lifecycle Event)
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:17:49 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:17:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Took 5.40 seconds to spawn the instance on the hypervisor.
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:17:49 user nova-compute[71312]: INFO nova.compute.manager [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Took 5.89 seconds to build instance.
Apr 14 06:17:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.981s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received event network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:17:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] No waiting events found dispatching network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:17:49 user nova-compute[71312]: WARNING nova.compute.manager [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received unexpected event network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 for instance with vm_state active and task_state None.
Apr 14 06:17:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:17:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:17:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:17:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:17:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:18:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:18:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:18:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:18:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:18:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:18:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:18:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:18:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:18:29 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=26.154605865478516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance aed587e2-a592-4241-9088-d15c4856f6f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:18:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "edc258d3-78b8-4f61-a648-6452dcc62355" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:33 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:18:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:33 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:18:33 user nova-compute[71312]: INFO nova.compute.claims [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Claim successful on node user
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:18:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.policy [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:18:34 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Creating image(s)
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.189s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "6cf8ae21-6690-4390-9990-690333025c17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk 1073741824" returned: 0 in 0.072s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:34 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:18:34 user nova-compute[71312]: INFO nova.compute.claims [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Claim successful on node user
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Successfully created port: 6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Cannot resize image /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'migration_context' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Ensure instance console log exists: /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:18:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.policy [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:18:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Creating image(s)
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.164s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Skipping network cache update for instance because it is Building. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Skipping network cache update for instance because it is Building. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.180s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Successfully updated port: 6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk 1073741824" returned: 0 in 0.078s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-changed-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.compute.manager [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Refreshing instance network info cache due to event network-changed-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.160s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Cannot resize image /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'migration_context' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Ensure instance console log exists: /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance network_info: |[{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Refreshing network info cache for port 6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Start _get_guest_xml network_info=[{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updating instance_info_cache with network_info: [{"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:18:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:18:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1264137081',display_name='tempest-ServerRescueNegativeTestJSON-server-1264137081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1264137081',id=41,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-kkk93xhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:18:34Z,user_data=None,user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=edc258d3-78b8-4f61-a648-6452dcc62355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7f3c2e-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'pci_devices' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:18:36 user nova-compute[71312]:   <uuid>edc258d3-78b8-4f61-a648-6452dcc62355</uuid>
Apr 14 06:18:36 user nova-compute[71312]:   <name>instance-00000029</name>
Apr 14 06:18:36 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:18:36 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:18:36 user nova-compute[71312]:   <metadata>
Apr 14 06:18:36 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:18:36 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:18:36 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1264137081</nova:name>
Apr 14 06:18:36 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:18:36</nova:creationTime>
Apr 14 06:18:36 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:18:36 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:18:36 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:18:36 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:18:36 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:18:36 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:18:36 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:18:36 user nova-compute[71312]:       <nova:owner>
Apr 14 06:18:36 user nova-compute[71312]:         <nova:user uuid="67c2d41a3a2e40a3bc67feafbfe4f5ca">tempest-ServerRescueNegativeTestJSON-140136450-project-member</nova:user>
Apr 14 06:18:36 user nova-compute[71312]:         <nova:project uuid="a6d89d9d942e49ecab2a2449b275fa7e">tempest-ServerRescueNegativeTestJSON-140136450</nova:project>
Apr 14 06:18:36 user nova-compute[71312]:       </nova:owner>
Apr 14 06:18:36 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:18:36 user nova-compute[71312]:       <nova:ports>
Apr 14 06:18:36 user nova-compute[71312]:         <nova:port uuid="6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230">
Apr 14 06:18:36 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 06:18:36 user nova-compute[71312]:         </nova:port>
Apr 14 06:18:36 user nova-compute[71312]:       </nova:ports>
Apr 14 06:18:36 user nova-compute[71312]:     </nova:instance>
Apr 14 06:18:36 user nova-compute[71312]:   </metadata>
Apr 14 06:18:36 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:18:36 user nova-compute[71312]:     <system>
Apr 14 06:18:36 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:18:36 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:18:36 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:18:36 user nova-compute[71312]:       <entry name="serial">edc258d3-78b8-4f61-a648-6452dcc62355</entry>
Apr 14 06:18:36 user nova-compute[71312]:       <entry name="uuid">edc258d3-78b8-4f61-a648-6452dcc62355</entry>
Apr 14 06:18:36 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:18:36 user nova-compute[71312]:     </system>
Apr 14 06:18:36 user nova-compute[71312]:   </sysinfo>
Apr 14 06:18:36 user nova-compute[71312]:   <os>
Apr 14 06:18:36 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:18:36 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:18:36 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:18:36 user nova-compute[71312]:   </os>
Apr 14 06:18:36 user nova-compute[71312]:   <features>
Apr 14 06:18:36 user nova-compute[71312]:     <acpi/>
Apr 14 06:18:36 user nova-compute[71312]:     <apic/>
Apr 14 06:18:36 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:18:36 user nova-compute[71312]:   </features>
Apr 14 06:18:36 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:18:36 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:18:36 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:18:36 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:18:36 user nova-compute[71312]:   </clock>
Apr 14 06:18:36 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:18:36 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:18:36 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:18:36 user nova-compute[71312]:   </cpu>
Apr 14 06:18:36 user nova-compute[71312]:   <devices>
Apr 14 06:18:36 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:18:36 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:18:36 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk"/>
Apr 14 06:18:36 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:18:36 user nova-compute[71312]:     </disk>
Apr 14 06:18:36 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:18:36 user nova-compute[71312]:       <mac address="fa:16:3e:ca:98:b5"/>
Apr 14 06:18:36 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:18:36 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:18:36 user nova-compute[71312]:       <target dev="tap6f7f3c2e-3e"/>
Apr 14 06:18:36 user nova-compute[71312]:     </interface>
Apr 14 06:18:36 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:18:36 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/console.log" append="off"/>
Apr 14 06:18:36 user nova-compute[71312]:     </serial>
Apr 14 06:18:36 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:18:36 user nova-compute[71312]:     <video>
Apr 14 06:18:36 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:18:36 user nova-compute[71312]:     </video>
Apr 14 06:18:36 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:18:36 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:18:36 user nova-compute[71312]:     </rng>
Apr 14 06:18:36 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:18:36 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:18:36 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:18:36 user nova-compute[71312]:     </memballoon>
Apr 14 06:18:36 user nova-compute[71312]:   </devices>
Apr 14 06:18:36 user nova-compute[71312]: </domain>
Apr 14 06:18:36 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1264137081',display_name='tempest-ServerRescueNegativeTestJSON-server-1264137081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1264137081',id=41,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-kkk93xhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:18:34Z,user_data=None,user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=edc258d3-78b8-4f61-a648-6452dcc62355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7f3c2e-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG os_vif [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7f3c2e-3e') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f7f3c2e-3e, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f7f3c2e-3e, col_values=(('external_ids', {'iface-id': '6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:98:b5', 'vm-uuid': 'edc258d3-78b8-4f61-a648-6452dcc62355'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:36 user nova-compute[71312]: INFO os_vif [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7f3c2e-3e')
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No VIF found with MAC fa:16:3e:ca:98:b5, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Successfully created port: 47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updated VIF entry in instance network info cache for port 6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG nova.network.neutron [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:18:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Successfully updated port: 47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquired lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-changed-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Refreshing instance network info cache due to event network-changed-47437095-940c-4fcc-bc27-5c8698e99a59. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] Acquiring lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Releasing lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Instance network_info: |[{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] Acquired lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.neutron [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Refreshing network info cache for port 47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Start _get_guest_xml network_info=[{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:18:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:18:37 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-897572158',display_name='tempest-ServerRescueNegativeTestJSON-server-897572158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-897572158',id=42,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-o79m09fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:18:36Z,user_data=None,user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=6cf8ae21-6690-4390-9990-690333025c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:81:65,bridge_name='br-int',has_traffic_filtering=True,id=47437095-940c-4fcc-bc27-5c8698e99a59,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47437095-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:18:37 user nova-compute[71312]:   <uuid>6cf8ae21-6690-4390-9990-690333025c17</uuid>
Apr 14 06:18:37 user nova-compute[71312]:   <name>instance-0000002a</name>
Apr 14 06:18:37 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:18:37 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:18:37 user nova-compute[71312]:   <metadata>
Apr 14 06:18:37 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:18:37 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:18:37 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-897572158</nova:name>
Apr 14 06:18:37 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:18:37</nova:creationTime>
Apr 14 06:18:37 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:18:37 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:18:37 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:18:37 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:18:37 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:18:37 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:18:37 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:18:37 user nova-compute[71312]:       <nova:owner>
Apr 14 06:18:37 user nova-compute[71312]:         <nova:user uuid="67c2d41a3a2e40a3bc67feafbfe4f5ca">tempest-ServerRescueNegativeTestJSON-140136450-project-member</nova:user>
Apr 14 06:18:37 user nova-compute[71312]:         <nova:project uuid="a6d89d9d942e49ecab2a2449b275fa7e">tempest-ServerRescueNegativeTestJSON-140136450</nova:project>
Apr 14 06:18:37 user nova-compute[71312]:       </nova:owner>
Apr 14 06:18:37 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:18:37 user nova-compute[71312]:       <nova:ports>
Apr 14 06:18:37 user nova-compute[71312]:         <nova:port uuid="47437095-940c-4fcc-bc27-5c8698e99a59">
Apr 14 06:18:37 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 06:18:37 user nova-compute[71312]:         </nova:port>
Apr 14 06:18:37 user nova-compute[71312]:       </nova:ports>
Apr 14 06:18:37 user nova-compute[71312]:     </nova:instance>
Apr 14 06:18:37 user nova-compute[71312]:   </metadata>
Apr 14 06:18:37 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:18:37 user nova-compute[71312]:     <system>
Apr 14 06:18:37 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:18:37 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:18:37 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:18:37 user nova-compute[71312]:       <entry name="serial">6cf8ae21-6690-4390-9990-690333025c17</entry>
Apr 14 06:18:37 user nova-compute[71312]:       <entry name="uuid">6cf8ae21-6690-4390-9990-690333025c17</entry>
Apr 14 06:18:37 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:18:37 user nova-compute[71312]:     </system>
Apr 14 06:18:37 user nova-compute[71312]:   </sysinfo>
Apr 14 06:18:37 user nova-compute[71312]:   <os>
Apr 14 06:18:37 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:18:37 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:18:37 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:18:37 user nova-compute[71312]:   </os>
Apr 14 06:18:37 user nova-compute[71312]:   <features>
Apr 14 06:18:37 user nova-compute[71312]:     <acpi/>
Apr 14 06:18:37 user nova-compute[71312]:     <apic/>
Apr 14 06:18:37 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:18:37 user nova-compute[71312]:   </features>
Apr 14 06:18:37 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:18:37 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:18:37 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:18:37 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:18:37 user nova-compute[71312]:   </clock>
Apr 14 06:18:37 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:18:37 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:18:37 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:18:37 user nova-compute[71312]:   </cpu>
Apr 14 06:18:37 user nova-compute[71312]:   <devices>
Apr 14 06:18:37 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:18:37 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:18:37 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk"/>
Apr 14 06:18:37 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:18:37 user nova-compute[71312]:     </disk>
Apr 14 06:18:37 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:18:37 user nova-compute[71312]:       <mac address="fa:16:3e:e8:81:65"/>
Apr 14 06:18:37 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:18:37 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:18:37 user nova-compute[71312]:       <target dev="tap47437095-94"/>
Apr 14 06:18:37 user nova-compute[71312]:     </interface>
Apr 14 06:18:37 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:18:37 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/console.log" append="off"/>
Apr 14 06:18:37 user nova-compute[71312]:     </serial>
Apr 14 06:18:37 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:18:37 user nova-compute[71312]:     <video>
Apr 14 06:18:37 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:18:37 user nova-compute[71312]:     </video>
Apr 14 06:18:37 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:18:37 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:18:37 user nova-compute[71312]:     </rng>
Apr 14 06:18:37 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:18:37 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:18:37 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:18:37 user nova-compute[71312]:     </memballoon>
Apr 14 06:18:37 user nova-compute[71312]:   </devices>
Apr 14 06:18:37 user nova-compute[71312]: </domain>
Apr 14 06:18:37 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-897572158',display_name='tempest-ServerRescueNegativeTestJSON-server-897572158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-897572158',id=42,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-o79m09fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:18:36Z,user_data=None,user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=6cf8ae21-6690-4390-9990-690333025c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:81:65,bridge_name='br-int',has_traffic_filtering=True,id=47437095-940c-4fcc-bc27-5c8698e99a59,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47437095-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG os_vif [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:81:65,bridge_name='br-int',has_traffic_filtering=True,id=47437095-940c-4fcc-bc27-5c8698e99a59,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47437095-94') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47437095-94, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47437095-94, col_values=(('external_ids', {'iface-id': '47437095-940c-4fcc-bc27-5c8698e99a59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:81:65', 'vm-uuid': '6cf8ae21-6690-4390-9990-690333025c17'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:37 user nova-compute[71312]: INFO os_vif [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:81:65,bridge_name='br-int',has_traffic_filtering=True,id=47437095-940c-4fcc-bc27-5c8698e99a59,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47437095-94')
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:18:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No VIF found with MAC fa:16:3e:e8:81:65, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:18:38 user nova-compute[71312]: WARNING nova.compute.manager [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state building and task_state spawning.
Apr 14 06:18:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updated VIF entry in instance network info cache for port 47437095-940c-4fcc-bc27-5c8698e99a59. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG nova.network.neutron [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] Releasing lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:18:40 user nova-compute[71312]: WARNING nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state building and task_state spawning.
Apr 14 06:18:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] No waiting events found dispatching network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:18:40 user nova-compute[71312]: WARNING nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received unexpected event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 for instance with vm_state building and task_state spawning.
Apr 14 06:18:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] No waiting events found dispatching network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:18:40 user nova-compute[71312]: WARNING nova.compute.manager [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received unexpected event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 for instance with vm_state building and task_state spawning.
Apr 14 06:18:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453121.0572393, edc258d3-78b8-4f61-a648-6452dcc62355 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] VM Resumed (Lifecycle Event)
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance spawned successfully.
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453121.0587957, edc258d3-78b8-4f61-a648-6452dcc62355 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] VM Started (Lifecycle Event)
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Took 6.74 seconds to spawn the instance on the hypervisor.
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Took 7.37 seconds to build instance.
Apr 14 06:18:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "edc258d3-78b8-4f61-a648-6452dcc62355" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.493s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453121.5482683, 6cf8ae21-6690-4390-9990-690333025c17 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] VM Resumed (Lifecycle Event)
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Instance spawned successfully.
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453121.5494385, 6cf8ae21-6690-4390-9990-690333025c17 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] VM Started (Lifecycle Event)
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Took 6.09 seconds to spawn the instance on the hypervisor.
Apr 14 06:18:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:18:41 user nova-compute[71312]: INFO nova.compute.manager [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Took 6.91 seconds to build instance.
Apr 14 06:18:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "6cf8ae21-6690-4390-9990-690333025c17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.047s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:18:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:18:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:18:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:18:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:19:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:19:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:19:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:19:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:22 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:19:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=26.112285614013672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance aed587e2-a592-4241-9088-d15c4856f6f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:19:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:19:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received event network-changed-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:19:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Refreshing instance network info cache due to event network-changed-7bca777d-f535-4686-8b83-bb2d216cb909. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] Acquiring lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] Acquired lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:19:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Refreshing network info cache for port 7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:19:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updated VIF entry in instance network info cache for port 7bca777d-f535-4686-8b83-bb2d216cb909. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:19:35 user nova-compute[71312]: DEBUG nova.network.neutron [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updating instance_info_cache with network_info: [{"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:19:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] Releasing lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:19:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:19:38 user nova-compute[71312]: INFO nova.compute.manager [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Attaching volume 24895241-f12a-4e80-80f0-7a0fa5cab5df to /dev/vdb
Apr 14 06:19:38 user nova-compute[71312]: DEBUG os_brick.utils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8eec0e-8013-4642-aa7d-2c6b7ed1c0ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bd3357-cddb-4ef5-8d07-00b1b9699056]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4336fe-fa7d-4856-ad02-bd1000093678]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c3c4e-e671-434a-90ba-4ed57211b229]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:19:38 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[01787a00-251d-44a1-934a-18cd45be1281]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG os_brick.utils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updating existing volume attachment record: d0f81bdb-a60a-4f99-a519-52ce2f68b71f {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updating instance_info_cache with network_info: [{"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-aed587e2-a592-4241-9088-d15c4856f6f8" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:19:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:19:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KydtCcEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:19:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:19:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:19:42 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e99a73-3a0f-4598-a29f-55869ffa1471]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:19:42 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba79f8b-1274-455e-8f21-8a0f026d5572]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df] added
Apr 14 06:19:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0936795-e98d-477f-af1a-47d374dd11ea]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64339503-b98f-4771-9e97-c0cb572349a8]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KydtCcEx {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KydtCcEx" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5354183e-d188-405f-b81e-8a4cc0c71458]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KydtCcEx'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a8a850-ba76-430d-9405-da86ea2afab3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb700490-f24d-4224-a6ff-14b82c323612]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:19:42 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:19:42 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:19:42 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 06:19:42 user nova-compute[71312]: 
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8fe528-00b4-402e-88d3-e815dc838968]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df, portal: 172.16.0.220,3260]
Apr 14 06:19:42 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df, portal: 172.16.0.220,3260] successful.
Apr 14 06:19:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b03bd80-7381-4617-9a1f-36a0b139183c]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e478f895-aeb7-4fec-a757-e9f1ec5bd13a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df (non-flash)
Apr 14 06:19:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df (non-flash)
Apr 14 06:19:42 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d64686-f41b-4366-b8cd-b607ff0ae820]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:19:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:43 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:19:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KydtCcEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:19:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:19:43 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26130343964393832', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:19:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130343964393832', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:19:43 user nova-compute[71312]: DEBUG nova.objects.instance [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:19:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:19:43 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:19:43 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:19:43 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:19:43 user nova-compute[71312]:   <serial>24895241-f12a-4e80-80f0-7a0fa5cab5df</serial>
Apr 14 06:19:43 user nova-compute[71312]: </disk>
Apr 14 06:19:43 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:19:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:19:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:19:44 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No VIF found with MAC fa:16:3e:38:3f:c3, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:19:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.330s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:19:45 user nova-compute[71312]: INFO nova.compute.manager [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Detaching volume 24895241-f12a-4e80-80f0-7a0fa5cab5df
Apr 14 06:19:45 user nova-compute[71312]: INFO nova.virt.block_device [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Attempting to driver detach volume 24895241-f12a-4e80-80f0-7a0fa5cab5df from mountpoint /dev/vdb
Apr 14 06:19:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Attempting to detach device vdb from instance aed587e2-a592-4241-9088-d15c4856f6f8 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:19:45 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:19:45 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:19:45 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:19:45 user nova-compute[71312]:   <serial>24895241-f12a-4e80-80f0-7a0fa5cab5df</serial>
Apr 14 06:19:45 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:19:45 user nova-compute[71312]: </disk>
Apr 14 06:19:45 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:19:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully detached device vdb from instance aed587e2-a592-4241-9088-d15c4856f6f8 from the persistent domain config.
Apr 14 06:19:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aed587e2-a592-4241-9088-d15c4856f6f8 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:19:45 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:19:45 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:19:45 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:19:45 user nova-compute[71312]:   <serial>24895241-f12a-4e80-80f0-7a0fa5cab5df</serial>
Apr 14 06:19:45 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:19:45 user nova-compute[71312]: </disk>
Apr 14 06:19:45 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681453185.5029662, aed587e2-a592-4241-9088-d15c4856f6f8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:19:45 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully detached device vdb from instance aed587e2-a592-4241-9088-d15c4856f6f8 from the live domain config.
Apr 14 06:19:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KydtCcEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:19:45 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0862331-a7d7-4118-a928-efc84a89f04a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:19:45 user nova-compute[71312]: No targets found.
Apr 14 06:19:45 user nova-compute[71312]: iSNS:
Apr 14 06:19:45 user nova-compute[71312]: No targets found.
Apr 14 06:19:45 user nova-compute[71312]: STATIC:
Apr 14 06:19:45 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df
Apr 14 06:19:45 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:19:45 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:19:45 user nova-compute[71312]: FIRMWARE:
Apr 14 06:19:45 user nova-compute[71312]: No targets found.
Apr 14 06:19:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:19:45 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:19:45 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f026fbb-d501-494f-b549-9ec16d596189]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0221d0eb-ec53-422b-80cc-5ae5c219b640]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df (non-flash)
Apr 14 06:19:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df (non-flash)
Apr 14 06:19:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49c416c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd3737b-8b06-4ff4-be00-ac2487a69dcc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[582bbf0c-6bd6-490d-b62c-55842b4d8924]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4462a0d-c904-454c-b576-7f193c3283ec]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25ff4bc-babf-4b03-adcf-3dcbec2a71e6]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec4e9b-0087-4461-ad95-ec1c5e51a05f]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0004bfef-8527-4e87-b662-a1bebbb1157e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df, portal: 172.16.0.220,3260]
Apr 14 06:19:45 user nova-compute[71312]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df, portal: 172.16.0.220,3260] successful.
Apr 14 06:19:45 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24895241-f12a-4e80-80f0-7a0fa5cab5df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c51b71-c640-4154-9ff8-217aad78f815]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== disconnect_volume: return (301ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:19:45 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:19:46 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:19:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.605s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:19:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:19:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:19:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:19:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:19:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:19:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:20:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:20:24 user nova-compute[71312]: INFO nova.compute.manager [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Rescuing
Apr 14 06:20:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:20:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquired lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:20:24 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:20:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG nova.network.neutron [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Releasing lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-unplugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG nova.compute.manager [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] No waiting events found dispatching network-vif-unplugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:20:25 user nova-compute[71312]: WARNING nova.compute.manager [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received unexpected event network-vif-unplugged-47437095-940c-4fcc-bc27-5c8698e99a59 for instance with vm_state active and task_state rescuing.
Apr 14 06:20:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Instance destroyed successfully.
Apr 14 06:20:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Attempting rescue
Apr 14 06:20:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 06:20:25 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Creating image(s)
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue" returned: 0 in 0.050s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:25 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'migration_context' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Start _get_guest_xml network_info=[{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:e8:81:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'resources' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'numa_topology' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:20:26 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:20:26 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-897572158',display_name='tempest-ServerRescueNegativeTestJSON-server-897572158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-897572158',id=42,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:18:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-o79m09fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:18:42Z,user_data=None,user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=6cf8ae21-6690-4390-9990-690333025c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:e8:81:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:e8:81:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:81:65,bridge_name='br-int',has_traffic_filtering=True,id=47437095-940c-4fcc-bc27-5c8698e99a59,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47437095-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.objects.instance [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:20:26 user nova-compute[71312]:   <uuid>6cf8ae21-6690-4390-9990-690333025c17</uuid>
Apr 14 06:20:26 user nova-compute[71312]:   <name>instance-0000002a</name>
Apr 14 06:20:26 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:20:26 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:20:26 user nova-compute[71312]:   <metadata>
Apr 14 06:20:26 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:20:26 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:20:26 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-897572158</nova:name>
Apr 14 06:20:26 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:20:26</nova:creationTime>
Apr 14 06:20:26 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:20:26 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:20:26 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:20:26 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:20:26 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:20:26 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:20:26 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:20:26 user nova-compute[71312]:       <nova:owner>
Apr 14 06:20:26 user nova-compute[71312]:         <nova:user uuid="67c2d41a3a2e40a3bc67feafbfe4f5ca">tempest-ServerRescueNegativeTestJSON-140136450-project-member</nova:user>
Apr 14 06:20:26 user nova-compute[71312]:         <nova:project uuid="a6d89d9d942e49ecab2a2449b275fa7e">tempest-ServerRescueNegativeTestJSON-140136450</nova:project>
Apr 14 06:20:26 user nova-compute[71312]:       </nova:owner>
Apr 14 06:20:26 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:20:26 user nova-compute[71312]:       <nova:ports>
Apr 14 06:20:26 user nova-compute[71312]:         <nova:port uuid="47437095-940c-4fcc-bc27-5c8698e99a59">
Apr 14 06:20:26 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 06:20:26 user nova-compute[71312]:         </nova:port>
Apr 14 06:20:26 user nova-compute[71312]:       </nova:ports>
Apr 14 06:20:26 user nova-compute[71312]:     </nova:instance>
Apr 14 06:20:26 user nova-compute[71312]:   </metadata>
Apr 14 06:20:26 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:20:26 user nova-compute[71312]:     <system>
Apr 14 06:20:26 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:20:26 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:20:26 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:20:26 user nova-compute[71312]:       <entry name="serial">6cf8ae21-6690-4390-9990-690333025c17</entry>
Apr 14 06:20:26 user nova-compute[71312]:       <entry name="uuid">6cf8ae21-6690-4390-9990-690333025c17</entry>
Apr 14 06:20:26 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:20:26 user nova-compute[71312]:     </system>
Apr 14 06:20:26 user nova-compute[71312]:   </sysinfo>
Apr 14 06:20:26 user nova-compute[71312]:   <os>
Apr 14 06:20:26 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:20:26 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:20:26 user nova-compute[71312]:   </os>
Apr 14 06:20:26 user nova-compute[71312]:   <features>
Apr 14 06:20:26 user nova-compute[71312]:     <acpi/>
Apr 14 06:20:26 user nova-compute[71312]:     <apic/>
Apr 14 06:20:26 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:20:26 user nova-compute[71312]:   </features>
Apr 14 06:20:26 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:20:26 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:20:26 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:20:26 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:20:26 user nova-compute[71312]:   </clock>
Apr 14 06:20:26 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:20:26 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:20:26 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:20:26 user nova-compute[71312]:   </cpu>
Apr 14 06:20:26 user nova-compute[71312]:   <devices>
Apr 14 06:20:26 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:20:26 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:20:26 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue"/>
Apr 14 06:20:26 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:20:26 user nova-compute[71312]:     </disk>
Apr 14 06:20:26 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:20:26 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:20:26 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk"/>
Apr 14 06:20:26 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 06:20:26 user nova-compute[71312]:     </disk>
Apr 14 06:20:26 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:20:26 user nova-compute[71312]:       <mac address="fa:16:3e:e8:81:65"/>
Apr 14 06:20:26 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:20:26 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:20:26 user nova-compute[71312]:       <target dev="tap47437095-94"/>
Apr 14 06:20:26 user nova-compute[71312]:     </interface>
Apr 14 06:20:26 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:20:26 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/console.log" append="off"/>
Apr 14 06:20:26 user nova-compute[71312]:     </serial>
Apr 14 06:20:26 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:20:26 user nova-compute[71312]:     <video>
Apr 14 06:20:26 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:20:26 user nova-compute[71312]:     </video>
Apr 14 06:20:26 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:20:26 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:20:26 user nova-compute[71312]:     </rng>
Apr 14 06:20:26 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:20:26 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:20:26 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:20:26 user nova-compute[71312]:     </memballoon>
Apr 14 06:20:26 user nova-compute[71312]:   </devices>
Apr 14 06:20:26 user nova-compute[71312]: </domain>
Apr 14 06:20:26 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:20:26 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Instance destroyed successfully.
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:20:26 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No VIF found with MAC fa:16:3e:e8:81:65, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] No waiting events found dispatching network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:20:27 user nova-compute[71312]: WARNING nova.compute.manager [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received unexpected event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 for instance with vm_state active and task_state rescuing.
Apr 14 06:20:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:28 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:20:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] No waiting events found dispatching network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:20:29 user nova-compute[71312]: WARNING nova.compute.manager [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received unexpected event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 for instance with vm_state active and task_state rescuing.
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] No waiting events found dispatching network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:20:29 user nova-compute[71312]: WARNING nova.compute.manager [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received unexpected event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 for instance with vm_state active and task_state rescuing.
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for 6cf8ae21-6690-4390-9990-690333025c17 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453229.5995746, 6cf8ae21-6690-4390-9990-690333025c17 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:20:29 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] VM Resumed (Lifecycle Event)
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:29 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453229.6023042, 6cf8ae21-6690-4390-9990-690333025c17 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:20:29 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] VM Started (Lifecycle Event)
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:20:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:20:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:20:30 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8624MB free_disk=26.110595703125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance aed587e2-a592-4241-9088-d15c4856f6f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:20:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:35 user nova-compute[71312]: INFO nova.compute.manager [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Terminating instance
Apr 14 06:20:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received event network-vif-unplugged-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] No waiting events found dispatching network-vif-unplugged-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:20:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received event network-vif-unplugged-7bca777d-f535-4686-8b83-bb2d216cb909 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:20:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Instance destroyed successfully.
Apr 14 06:20:36 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'resources' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-859725183',display_name='tempest-AttachVolumeNegativeTest-server-859725183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-859725183',id=40,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHl9rjESEyj/xQy1K6phJqwsUzo/nEYL//jJfu5dMId2YL4VarlPegLgYPQgivwb2Wqs9qt4pL/mOlAlpvvQXPcmK6ZzLy9k8NgQpR8zO8LRfwfDcZ7lzSso7PTHYh8G8g==',key_name='tempest-keypair-1767081454',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-4kll0lno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=aed587e2-a592-4241-9088-d15c4856f6f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "7bca777d-f535-4686-8b83-bb2d216cb909", "address": "fa:16:3e:38:3f:c3", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bca777d-f5", "ovs_interfaceid": "7bca777d-f535-4686-8b83-bb2d216cb909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=7bca777d-f535-4686-8b83-bb2d216cb909,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bca777d-f5') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG os_vif [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=7bca777d-f535-4686-8b83-bb2d216cb909,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bca777d-f5') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bca777d-f5, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:20:36 user nova-compute[71312]: INFO os_vif [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=7bca777d-f535-4686-8b83-bb2d216cb909,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bca777d-f5')
Apr 14 06:20:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Deleting instance files /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8_del
Apr 14 06:20:36 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Deletion of /opt/stack/data/nova/instances/aed587e2-a592-4241-9088-d15c4856f6f8_del complete
Apr 14 06:20:36 user nova-compute[71312]: INFO nova.compute.manager [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 06:20:36 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:20:36 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:20:36 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Took 0.68 seconds to deallocate network for instance.
Apr 14 06:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-e050e7bb-e915-4224-8e8e-7e4dfdfebec9 req-6a26a450-80f3-4815-aecc-6e1f7961d8a3 service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received event network-vif-deleted-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:37 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Deleted allocations for instance aed587e2-a592-4241-9088-d15c4856f6f8
Apr 14 06:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "aed587e2-a592-4241-9088-d15c4856f6f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received event network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] Acquiring lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] Lock "aed587e2-a592-4241-9088-d15c4856f6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:20:37 user nova-compute[71312]: DEBUG nova.compute.manager [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] No waiting events found dispatching network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:20:37 user nova-compute[71312]: WARNING nova.compute.manager [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Received unexpected event network-vif-plugged-7bca777d-f535-4686-8b83-bb2d216cb909 for instance with vm_state deleted and task_state None.
Apr 14 06:20:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:20:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:20:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:20:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:20:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:20:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:20:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:20:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:20:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:20:51 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681453236.1928306, aed587e2-a592-4241-9088-d15c4856f6f8 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:20:51 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] VM Stopped (Lifecycle Event)
Apr 14 06:20:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-39567323-3ed6-47b4-a56c-6fe48de0f9b5 None None] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:20:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:20:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:21:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:21:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:21:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:21:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:24 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:25 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:21:29 user nova-compute[71312]: INFO nova.compute.claims [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Claim successful on node user
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.policy [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:21:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Creating image(s)
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "/opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "/opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:29 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk 1073741824" returned: 0 in 0.063s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Cannot resize image /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'migration_context' on Instance uuid 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Ensure instance console log exists: /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:30 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Successfully created port: 686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:21:31 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:21:31 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=26.110164642333984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Successfully updated port: 686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquired lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received event network-changed-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Refreshing instance network info cache due to event network-changed-686f7f32-506f-4cc9-850e-c03b3925c762. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] Acquiring lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.neutron [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Updating instance_info_cache with network_info: [{"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Releasing lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Instance network_info: |[{"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] Acquired lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.neutron [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Refreshing network info cache for port 686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Start _get_guest_xml network_info=[{"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:21:31 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:21:31 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-391821891',display_name='tempest-AttachVolumeNegativeTest-server-391821891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-391821891',id=43,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbZiTImq4OyW9Y7TV31bmJcjlgIUIWW7knzm0I2QP/Bk9oXJfEytnwR+0Sdt4v7pfe2uAJH5vGwi3eBLHWfEPLj+8plldB5t43Pea0+duLejtopometmPzUNIp0VYb0QQ==',key_name='tempest-keypair-571487004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-lt4ashm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=8c038bb5-1cd7-412b-9f53-6fd7ea81b623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:40:73,bridge_name='br-int',has_traffic_filtering=True,id=686f7f32-506f-4cc9-850e-c03b3925c762,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686f7f32-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.objects.instance [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:21:31 user nova-compute[71312]:   <uuid>8c038bb5-1cd7-412b-9f53-6fd7ea81b623</uuid>
Apr 14 06:21:31 user nova-compute[71312]:   <name>instance-0000002b</name>
Apr 14 06:21:31 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:21:31 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:21:31 user nova-compute[71312]:   <metadata>
Apr 14 06:21:31 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:21:31 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:21:31 user nova-compute[71312]:       <nova:name>tempest-AttachVolumeNegativeTest-server-391821891</nova:name>
Apr 14 06:21:31 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:21:31</nova:creationTime>
Apr 14 06:21:31 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:21:31 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:21:31 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:21:31 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:21:31 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:21:31 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:21:31 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:21:31 user nova-compute[71312]:       <nova:owner>
Apr 14 06:21:31 user nova-compute[71312]:         <nova:user uuid="6ce33b21c6d541a0a4885680baf52f64">tempest-AttachVolumeNegativeTest-426432803-project-member</nova:user>
Apr 14 06:21:31 user nova-compute[71312]:         <nova:project uuid="86f67a892b9045089159f210e7db3a80">tempest-AttachVolumeNegativeTest-426432803</nova:project>
Apr 14 06:21:31 user nova-compute[71312]:       </nova:owner>
Apr 14 06:21:31 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:21:31 user nova-compute[71312]:       <nova:ports>
Apr 14 06:21:31 user nova-compute[71312]:         <nova:port uuid="686f7f32-506f-4cc9-850e-c03b3925c762">
Apr 14 06:21:31 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 06:21:31 user nova-compute[71312]:         </nova:port>
Apr 14 06:21:31 user nova-compute[71312]:       </nova:ports>
Apr 14 06:21:31 user nova-compute[71312]:     </nova:instance>
Apr 14 06:21:31 user nova-compute[71312]:   </metadata>
Apr 14 06:21:31 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:21:31 user nova-compute[71312]:     <system>
Apr 14 06:21:31 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:21:31 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:21:31 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:21:31 user nova-compute[71312]:       <entry name="serial">8c038bb5-1cd7-412b-9f53-6fd7ea81b623</entry>
Apr 14 06:21:31 user nova-compute[71312]:       <entry name="uuid">8c038bb5-1cd7-412b-9f53-6fd7ea81b623</entry>
Apr 14 06:21:31 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:21:31 user nova-compute[71312]:     </system>
Apr 14 06:21:31 user nova-compute[71312]:   </sysinfo>
Apr 14 06:21:31 user nova-compute[71312]:   <os>
Apr 14 06:21:31 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:21:31 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:21:31 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:21:31 user nova-compute[71312]:   </os>
Apr 14 06:21:31 user nova-compute[71312]:   <features>
Apr 14 06:21:31 user nova-compute[71312]:     <acpi/>
Apr 14 06:21:31 user nova-compute[71312]:     <apic/>
Apr 14 06:21:31 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:21:31 user nova-compute[71312]:   </features>
Apr 14 06:21:31 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:21:31 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:21:31 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:21:31 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:21:31 user nova-compute[71312]:   </clock>
Apr 14 06:21:31 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:21:31 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:21:31 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:21:31 user nova-compute[71312]:   </cpu>
Apr 14 06:21:31 user nova-compute[71312]:   <devices>
Apr 14 06:21:31 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:21:31 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:21:31 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk"/>
Apr 14 06:21:31 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:21:31 user nova-compute[71312]:     </disk>
Apr 14 06:21:31 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:21:31 user nova-compute[71312]:       <mac address="fa:16:3e:4f:40:73"/>
Apr 14 06:21:31 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:21:31 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:21:31 user nova-compute[71312]:       <target dev="tap686f7f32-50"/>
Apr 14 06:21:31 user nova-compute[71312]:     </interface>
Apr 14 06:21:31 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:21:31 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/console.log" append="off"/>
Apr 14 06:21:31 user nova-compute[71312]:     </serial>
Apr 14 06:21:31 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:21:31 user nova-compute[71312]:     <video>
Apr 14 06:21:31 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:21:31 user nova-compute[71312]:     </video>
Apr 14 06:21:31 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:21:31 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:21:31 user nova-compute[71312]:     </rng>
Apr 14 06:21:31 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:21:31 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:21:31 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:21:31 user nova-compute[71312]:     </memballoon>
Apr 14 06:21:31 user nova-compute[71312]:   </devices>
Apr 14 06:21:31 user nova-compute[71312]: </domain>
Apr 14 06:21:31 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-391821891',display_name='tempest-AttachVolumeNegativeTest-server-391821891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-391821891',id=43,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbZiTImq4OyW9Y7TV31bmJcjlgIUIWW7knzm0I2QP/Bk9oXJfEytnwR+0Sdt4v7pfe2uAJH5vGwi3eBLHWfEPLj+8plldB5t43Pea0+duLejtopometmPzUNIp0VYb0QQ==',key_name='tempest-keypair-571487004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-lt4ashm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=8c038bb5-1cd7-412b-9f53-6fd7ea81b623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:40:73,bridge_name='br-int',has_traffic_filtering=True,id=686f7f32-506f-4cc9-850e-c03b3925c762,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686f7f32-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG os_vif [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:40:73,bridge_name='br-int',has_traffic_filtering=True,id=686f7f32-506f-4cc9-850e-c03b3925c762,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686f7f32-50') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap686f7f32-50, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap686f7f32-50, col_values=(('external_ids', {'iface-id': '686f7f32-506f-4cc9-850e-c03b3925c762', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:40:73', 'vm-uuid': '8c038bb5-1cd7-412b-9f53-6fd7ea81b623'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:31 user nova-compute[71312]: INFO os_vif [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:40:73,bridge_name='br-int',has_traffic_filtering=True,id=686f7f32-506f-4cc9-850e-c03b3925c762,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686f7f32-50')
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:21:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No VIF found with MAC fa:16:3e:4f:40:73, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:21:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Updated VIF entry in instance network info cache for port 686f7f32-506f-4cc9-850e-c03b3925c762. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:21:32 user nova-compute[71312]: DEBUG nova.network.neutron [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Updating instance_info_cache with network_info: [{"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:21:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] Releasing lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received event network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG nova.compute.manager [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] No waiting events found dispatching network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:21:33 user nova-compute[71312]: WARNING nova.compute.manager [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received unexpected event network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 for instance with vm_state building and task_state spawning.
Apr 14 06:21:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received event network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.compute.manager [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] No waiting events found dispatching network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:21:35 user nova-compute[71312]: WARNING nova.compute.manager [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received unexpected event network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 for instance with vm_state building and task_state spawning.
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453295.6584275, 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:21:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] VM Resumed (Lifecycle Event)
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:21:35 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Instance spawned successfully.
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:21:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453295.6602232, 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:21:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] VM Started (Lifecycle Event)
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:21:35 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:21:35 user nova-compute[71312]: INFO nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 14 06:21:35 user nova-compute[71312]: DEBUG nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:21:35 user nova-compute[71312]: INFO nova.compute.manager [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Took 6.52 seconds to build instance.
Apr 14 06:21:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.609s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:21:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:21:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:21:40 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:21:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:21:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:21:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:21:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:21:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Verify base images {{(pid=71312) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Image id 3644c9ad-79f4-4051-9ff8-56e591db88fa yields fingerprint 778f57ebc83a64a817f625aae4048c912f015620 {{(pid=71312) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 06:21:56 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] image 3644c9ad-79f4-4051-9ff8-56e591db88fa at (/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620): checking
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] image 3644c9ad-79f4-4051-9ff8-56e591db88fa at (/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620): image is in use {{(pid=71312) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71312) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 is a valid instance name {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 has a disk file {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 is backed by 778f57ebc83a64a817f625aae4048c912f015620 {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] edc258d3-78b8-4f61-a648-6452dcc62355 is a valid instance name {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] edc258d3-78b8-4f61-a648-6452dcc62355 has a disk file {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 06:21:56 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 is backed by 778f57ebc83a64a817f625aae4048c912f015620 {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] 6cf8ae21-6690-4390-9990-690333025c17 is a valid instance name {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] 6cf8ae21-6690-4390-9990-690333025c17 has a disk file {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 is backed by 778f57ebc83a64a817f625aae4048c912f015620 {{(pid=71312) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a
Apr 14 06:21:57 user nova-compute[71312]: WARNING nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Active base files: /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Removable base files: /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6 /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08 /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060 /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8beca99118516b9e994743abf0c4c66a81f524f6
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5829f1361080e38e95b111450c785f6ce7dc6f08
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04d16650ec2c47613ea23f3d7b69f6cff4ce183b
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1782d2f4cc60c28e3515daa896f4fe6002764060
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4d15f8c008b84b1efc031e2b71c858d4d5d3ddab
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b5ee41bdc5c6fe0bf1dad98cdb9b1d6ebb5d8f2e
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6f1a7896cbd22ba3cda6b9db265f9a57ea5545ba
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/51e04d1b1b8455c4d6a4fb966c248030107ab82a
Apr 14 06:21:57 user nova-compute[71312]: INFO nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c585a2f4240818c74a4db09500eef328cfe4048b
Apr 14 06:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Verification complete {{(pid=71312) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Verify swap images {{(pid=71312) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.imagecache [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Verify ephemeral images {{(pid=71312) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 14 06:21:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:22:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:22:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:22:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:27 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:22:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:22:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:22:31 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:22:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:22:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:22:32 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:22:33 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:22:33 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=26.07326889038086GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:22:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:22:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:22:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:22:41 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:22:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:22:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:22:41 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:22:41 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:22:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:42 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:22:42 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:22:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:22:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:22:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:22:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:22:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:22:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:22:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:23:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:23:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:23:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:23:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:18 user nova-compute[71312]: INFO nova.compute.manager [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Rescuing
Apr 14 06:23:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:18 user nova-compute[71312]: DEBUG nova.compute.manager [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:23:18 user nova-compute[71312]: WARNING nova.compute.manager [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state active and task_state rescuing.
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance destroyed successfully.
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Attempting rescue
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 06:23:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Creating image(s)
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'trusted_certs' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue" returned: 0 in 0.049s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'migration_context' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Start _get_guest_xml network_info=[{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:ca:98:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'resources' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'numa_topology' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:23:19 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'vcpu_model' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1264137081',display_name='tempest-ServerRescueNegativeTestJSON-server-1264137081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1264137081',id=41,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:18:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-kkk93xhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:18:41Z,user_data=None,user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=edc258d3-78b8-4f61-a648-6452dcc62355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:ca:98:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:ca:98:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7f3c2e-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.objects.instance [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'pci_devices' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:23:19 user nova-compute[71312]:   <uuid>edc258d3-78b8-4f61-a648-6452dcc62355</uuid>
Apr 14 06:23:19 user nova-compute[71312]:   <name>instance-00000029</name>
Apr 14 06:23:19 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:23:19 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:23:19 user nova-compute[71312]:   <metadata>
Apr 14 06:23:19 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:23:19 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:23:19 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1264137081</nova:name>
Apr 14 06:23:19 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:23:19</nova:creationTime>
Apr 14 06:23:19 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:23:19 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:23:19 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:23:19 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:23:19 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:23:19 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:23:19 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:23:19 user nova-compute[71312]:       <nova:owner>
Apr 14 06:23:19 user nova-compute[71312]:         <nova:user uuid="67c2d41a3a2e40a3bc67feafbfe4f5ca">tempest-ServerRescueNegativeTestJSON-140136450-project-member</nova:user>
Apr 14 06:23:19 user nova-compute[71312]:         <nova:project uuid="a6d89d9d942e49ecab2a2449b275fa7e">tempest-ServerRescueNegativeTestJSON-140136450</nova:project>
Apr 14 06:23:19 user nova-compute[71312]:       </nova:owner>
Apr 14 06:23:19 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:23:19 user nova-compute[71312]:       <nova:ports>
Apr 14 06:23:19 user nova-compute[71312]:         <nova:port uuid="6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230">
Apr 14 06:23:19 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 06:23:19 user nova-compute[71312]:         </nova:port>
Apr 14 06:23:19 user nova-compute[71312]:       </nova:ports>
Apr 14 06:23:19 user nova-compute[71312]:     </nova:instance>
Apr 14 06:23:19 user nova-compute[71312]:   </metadata>
Apr 14 06:23:19 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:23:19 user nova-compute[71312]:     <system>
Apr 14 06:23:19 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:23:19 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:23:19 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:23:19 user nova-compute[71312]:       <entry name="serial">edc258d3-78b8-4f61-a648-6452dcc62355</entry>
Apr 14 06:23:19 user nova-compute[71312]:       <entry name="uuid">edc258d3-78b8-4f61-a648-6452dcc62355</entry>
Apr 14 06:23:19 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:23:19 user nova-compute[71312]:     </system>
Apr 14 06:23:19 user nova-compute[71312]:   </sysinfo>
Apr 14 06:23:19 user nova-compute[71312]:   <os>
Apr 14 06:23:19 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:23:19 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:23:19 user nova-compute[71312]:   </os>
Apr 14 06:23:19 user nova-compute[71312]:   <features>
Apr 14 06:23:19 user nova-compute[71312]:     <acpi/>
Apr 14 06:23:19 user nova-compute[71312]:     <apic/>
Apr 14 06:23:19 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:23:19 user nova-compute[71312]:   </features>
Apr 14 06:23:19 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:23:19 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:23:19 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:23:19 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:23:19 user nova-compute[71312]:   </clock>
Apr 14 06:23:19 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:23:19 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:23:19 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:23:19 user nova-compute[71312]:   </cpu>
Apr 14 06:23:19 user nova-compute[71312]:   <devices>
Apr 14 06:23:19 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:23:19 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:23:19 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue"/>
Apr 14 06:23:19 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:23:19 user nova-compute[71312]:     </disk>
Apr 14 06:23:19 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:23:19 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:23:19 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk"/>
Apr 14 06:23:19 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 06:23:19 user nova-compute[71312]:     </disk>
Apr 14 06:23:19 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:23:19 user nova-compute[71312]:       <mac address="fa:16:3e:ca:98:b5"/>
Apr 14 06:23:19 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:23:19 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:23:19 user nova-compute[71312]:       <target dev="tap6f7f3c2e-3e"/>
Apr 14 06:23:19 user nova-compute[71312]:     </interface>
Apr 14 06:23:19 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:23:19 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/console.log" append="off"/>
Apr 14 06:23:19 user nova-compute[71312]:     </serial>
Apr 14 06:23:19 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:23:19 user nova-compute[71312]:     <video>
Apr 14 06:23:19 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:23:19 user nova-compute[71312]:     </video>
Apr 14 06:23:19 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:23:19 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:23:19 user nova-compute[71312]:     </rng>
Apr 14 06:23:19 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:23:19 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:23:19 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:23:19 user nova-compute[71312]:     </memballoon>
Apr 14 06:23:19 user nova-compute[71312]:   </devices>
Apr 14 06:23:19 user nova-compute[71312]: </domain>
Apr 14 06:23:19 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:23:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance destroyed successfully.
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No VIF found with MAC fa:16:3e:ca:98:b5, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received event network-changed-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Refreshing instance network info cache due to event network-changed-686f7f32-506f-4cc9-850e-c03b3925c762. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:23:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] Acquiring lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:23:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] Acquired lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:23:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Refreshing network info cache for port 686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:23:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Updated VIF entry in instance network info cache for port 686f7f32-506f-4cc9-850e-c03b3925c762. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:23:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Updating instance_info_cache with network_info: [{"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:23:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] Releasing lock "refresh_cache-8c038bb5-1cd7-412b-9f53-6fd7ea81b623" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:23:21 user nova-compute[71312]: WARNING nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state active and task_state rescuing.
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:23:21 user nova-compute[71312]: WARNING nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state active and task_state rescuing.
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:23:21 user nova-compute[71312]: WARNING nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state active and task_state rescuing.
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:23:21 user nova-compute[71312]: WARNING nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state active and task_state rescuing.
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:23:21 user nova-compute[71312]: WARNING nova.compute.manager [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state active and task_state rescuing.
Apr 14 06:23:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:23:23 user nova-compute[71312]: WARNING nova.compute.manager [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state active and task_state rescuing.
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:23:23 user nova-compute[71312]: WARNING nova.compute.manager [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state active and task_state rescuing.
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:23 user nova-compute[71312]: INFO nova.compute.manager [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Attaching volume e3a423ae-aa92-477f-b35e-22eff1fe2d12 to /dev/vdb
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for edc258d3-78b8-4f61-a648-6452dcc62355 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453403.1473608, edc258d3-78b8-4f61-a648-6452dcc62355 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:23:23 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] VM Resumed (Lifecycle Event)
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG os_brick.utils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24f095-e61e-4bfc-9069-f7c1d340dcfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:23 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453403.150812, edc258d3-78b8-4f61-a648-6452dcc62355 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:23:23 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] VM Started (Lifecycle Event)
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e62fdb-2192-47d0-badd-4ba4d142f1ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[edacecee-41fe-4245-b3df-95230f8d1446]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d288a600-bc72-48c2-8859-27d87eae66e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:23:23 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:23:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e36842b-db32-4c80-85dd-24eb581bd30f]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG os_brick.utils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:23:23 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Updating existing volume attachment record: 8fec7a56-468a-4cbe-8865-abe7a84a512e {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:23:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcMxhbYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:23:27 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:23:27 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:23:27 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b782ba9-906e-4dbb-928e-412045743373]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:23:27 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[888c294d-9edf-4c95-9f4d-c0095d0f15d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12] added
Apr 14 06:23:27 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6224831-06f3-46ba-8279-e19809a1fba3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1cd91-f79c-4914-9d0c-015e796c3903]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcMxhbYs {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcMxhbYs" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3766571e-64d4-4b0d-a9c0-7158778dca72]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcMxhbYs'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bfa3cc-1ba9-42cb-836f-91b72f7da110]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[216842bf-38c8-408c-ab72-bc83d336f1c8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:27 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:23:27 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:23:28 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:23:28 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 06:23:28 user nova-compute[71312]: 
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1de3a3-d90d-44ae-bfce-44429268e436]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12, portal: 172.16.0.220,3260]
Apr 14 06:23:28 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12, portal: 172.16.0.220,3260] successful.
Apr 14 06:23:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1cdd69-0adb-46b0-966b-0fc64b85f092]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd7a5ab-751a-44f5-8884-e9b9aa544e1f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 (non-flash)
Apr 14 06:23:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 (non-flash)
Apr 14 06:23:28 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a51e9c-7fde-4af5-a4be-2191ee16cf56]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:23:28 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcMxhbYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26133653036653530', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133653036653530', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:23:29 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:23:29 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:23:29 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:23:29 user nova-compute[71312]:   <serial>e3a423ae-aa92-477f-b35e-22eff1fe2d12</serial>
Apr 14 06:23:29 user nova-compute[71312]: </disk>
Apr 14 06:23:29 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] No VIF found with MAC fa:16:3e:4f:40:73, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.578s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:31 user nova-compute[71312]: INFO nova.compute.manager [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Detaching volume e3a423ae-aa92-477f-b35e-22eff1fe2d12
Apr 14 06:23:31 user nova-compute[71312]: INFO nova.virt.block_device [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Attempting to driver detach volume e3a423ae-aa92-477f-b35e-22eff1fe2d12 from mountpoint /dev/vdb
Apr 14 06:23:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Attempting to detach device vdb from instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:23:31 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:23:31 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:23:31 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:23:31 user nova-compute[71312]:   <serial>e3a423ae-aa92-477f-b35e-22eff1fe2d12</serial>
Apr 14 06:23:31 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:23:31 user nova-compute[71312]: </disk>
Apr 14 06:23:31 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:23:31 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully detached device vdb from instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 from the persistent domain config.
Apr 14 06:23:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:23:31 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:23:31 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:23:31 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:23:31 user nova-compute[71312]:   <serial>e3a423ae-aa92-477f-b35e-22eff1fe2d12</serial>
Apr 14 06:23:31 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:23:31 user nova-compute[71312]: </disk>
Apr 14 06:23:31 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681453411.4589682, 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:23:31 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully detached device vdb from instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 from the live domain config.
Apr 14 06:23:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcMxhbYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:23:31 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[911f0de9-6865-45a8-8444-731f53e1c107]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:23:31 user nova-compute[71312]: No targets found.
Apr 14 06:23:31 user nova-compute[71312]: iSNS:
Apr 14 06:23:31 user nova-compute[71312]: No targets found.
Apr 14 06:23:31 user nova-compute[71312]: STATIC:
Apr 14 06:23:31 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12
Apr 14 06:23:31 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:23:31 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:23:31 user nova-compute[71312]: FIRMWARE:
Apr 14 06:23:31 user nova-compute[71312]: No targets found.
Apr 14 06:23:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:23:31 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:23:31 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5909922b-9312-402c-a5de-705e19e08239]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[56645ed4-664e-4bef-b4f4-be078fe086ed]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 (non-flash)
Apr 14 06:23:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 (non-flash)
Apr 14 06:23:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49a453b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d488d6-dbfb-4b28-a120-e17238f0d80b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9523a4-43b7-4c30-a6e5-c659dd9a0805]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc836cf-8fd5-47ba-8394-607792b48979]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aa240d-e1ea-43d0-99d5-25498b400421]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8f42bc-c465-4ccf-8ff4-0a770af5e156]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[166b57f3-f560-4258-ba27-d15b14fe1255]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12, portal: 172.16.0.220,3260]
Apr 14 06:23:31 user nova-compute[71312]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12, portal: 172.16.0.220,3260] successful.
Apr 14 06:23:31 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a423ae-aa92-477f-b35e-22eff1fe2d12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cfa948-881b-47c5-a93a-7da08cd50886]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] <== disconnect_volume: return (261ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:23:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:32 user nova-compute[71312]: DEBUG nova.objects.instance [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'flavor' on Instance uuid 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:23:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.637s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:23:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:23:35 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:23:35 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:23:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8498MB free_disk=26.071147918701172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "edc258d3-78b8-4f61-a648-6452dcc62355" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "6cf8ae21-6690-4390-9990-690333025c17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "edc258d3-78b8-4f61-a648-6452dcc62355" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "6cf8ae21-6690-4390-9990-690333025c17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:23:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:23:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:23:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:23:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:23:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:23:43 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:23:44 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:23:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:23:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:23:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:23:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:24:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:24:21 user nova-compute[71312]: INFO nova.compute.manager [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Terminating instance
Apr 14 06:24:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received event network-vif-unplugged-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] No waiting events found dispatching network-vif-unplugged-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG nova.compute.manager [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received event network-vif-unplugged-686f7f32-506f-4cc9-850e-c03b3925c762 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Instance destroyed successfully.
Apr 14 06:24:22 user nova-compute[71312]: DEBUG nova.objects.instance [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'resources' on Instance uuid 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-391821891',display_name='tempest-AttachVolumeNegativeTest-server-391821891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-391821891',id=43,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbZiTImq4OyW9Y7TV31bmJcjlgIUIWW7knzm0I2QP/Bk9oXJfEytnwR+0Sdt4v7pfe2uAJH5vGwi3eBLHWfEPLj+8plldB5t43Pea0+duLejtopometmPzUNIp0VYb0QQ==',key_name='tempest-keypair-571487004',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:21:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86f67a892b9045089159f210e7db3a80',ramdisk_id='',reservation_id='r-lt4ashm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-426432803',owner_user_name='tempest-AttachVolumeNegativeTest-426432803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ce33b21c6d541a0a4885680baf52f64',uuid=8c038bb5-1cd7-412b-9f53-6fd7ea81b623,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converting VIF {"id": "686f7f32-506f-4cc9-850e-c03b3925c762", "address": "fa:16:3e:4f:40:73", "network": {"id": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-430185703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f67a892b9045089159f210e7db3a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap686f7f32-50", "ovs_interfaceid": "686f7f32-506f-4cc9-850e-c03b3925c762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:40:73,bridge_name='br-int',has_traffic_filtering=True,id=686f7f32-506f-4cc9-850e-c03b3925c762,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686f7f32-50') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG os_vif [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:40:73,bridge_name='br-int',has_traffic_filtering=True,id=686f7f32-506f-4cc9-850e-c03b3925c762,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686f7f32-50') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap686f7f32-50, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:24:22 user nova-compute[71312]: INFO os_vif [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:40:73,bridge_name='br-int',has_traffic_filtering=True,id=686f7f32-506f-4cc9-850e-c03b3925c762,network=Network(45c8f442-1ff6-4f22-99ec-a3d77b4ba848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap686f7f32-50')
Apr 14 06:24:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Deleting instance files /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623_del
Apr 14 06:24:22 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Deletion of /opt/stack/data/nova/instances/8c038bb5-1cd7-412b-9f53-6fd7ea81b623_del complete
Apr 14 06:24:22 user nova-compute[71312]: INFO nova.compute.manager [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 06:24:22 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:24:22 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:24:23 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Took 1.51 seconds to deallocate network for instance.
Apr 14 06:24:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received event network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] Acquiring lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] No waiting events found dispatching network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:24:23 user nova-compute[71312]: WARNING nova.compute.manager [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received unexpected event network-vif-plugged-686f7f32-506f-4cc9-850e-c03b3925c762 for instance with vm_state active and task_state deleting.
Apr 14 06:24:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG nova.compute.manager [req-93399ab5-4685-4c1e-8da5-4a81314bc580 req-9a8271e4-35cb-420f-a80a-be039cfad826 service nova] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Received event network-vif-deleted-686f7f32-506f-4cc9-850e-c03b3925c762 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:24:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:24:23 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Deleted allocations for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623
Apr 14 06:24:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "8c038bb5-1cd7-412b-9f53-6fd7ea81b623" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:24:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:28 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:29 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:24:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:24:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:24:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:24:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:24:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:24:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:24:35 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:24:35 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:24:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=26.07131576538086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:24:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:24:37 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681453462.0807178, 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:24:37 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] VM Stopped (Lifecycle Event)
Apr 14 06:24:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-18a80b54-88dd-4b37-b831-6140b9c36e69 None None] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:24:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:24:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:24:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:24:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:24:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:24:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:24:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:24:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:25:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:08 user nova-compute[71312]: INFO nova.compute.manager [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Unrescuing
Apr 14 06:25:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:25:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:25:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'flavor' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:25:09 user nova-compute[71312]: WARNING nova.compute.manager [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:25:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance destroyed successfully.
Apr 14 06:25:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:25:12 user nova-compute[71312]: WARNING nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:25:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:25:12 user nova-compute[71312]: WARNING nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:25:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:25:12 user nova-compute[71312]: WARNING nova.compute.manager [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:25:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for edc258d3-78b8-4f61-a648-6452dcc62355 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:25:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453513.402473, edc258d3-78b8-4f61-a648-6452dcc62355 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:25:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] VM Resumed (Lifecycle Event)
Apr 14 06:25:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:25:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:25:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:25:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 06:25:13 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453513.4039326, edc258d3-78b8-4f61-a648-6452dcc62355 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:25:13 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] VM Started (Lifecycle Event)
Apr 14 06:25:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:25:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:25:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:25:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:25:33 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:25:33 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:25:33 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:25:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:25:35 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:25:35 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:25:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=26.079814910888672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:25:35 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:25:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:25:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:25:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:25:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:25:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:25:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:25:45 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:25:45 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:25:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:25:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:25:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:25:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:25:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:26:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:26:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:26:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:26:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:26:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:26:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:26:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:30 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:26:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:26:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:26:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:26:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:26:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=26.078128814697266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:26:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:26:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:26:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:26:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:26:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:26:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:26:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:26:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:26:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:26:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:26:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:26:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:26:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:27:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:27:05 user nova-compute[71312]: INFO nova.compute.claims [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Claim successful on node user
Apr 14 06:27:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:27:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.policy [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:27:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Creating image(s)
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk 1073741824" returned: 0 in 0.048s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Successfully created port: 97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Cannot resize image /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'migration_context' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Ensure instance console log exists: /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Successfully updated port: 97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-changed-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Refreshing instance network info cache due to event network-changed-97104eed-fe3e-4803-a457-978bfeba469f. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:27:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance network_info: |[{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Refreshing network info cache for port 97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Start _get_guest_xml network_info=[{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:27:08 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:27:08 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-46421142',display_name='tempest-ServerRescueNegativeTestJSON-server-46421142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-46421142',id=44,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmp+2NPOMTYQbC0TeVNV78xcjBhWnxOAAiz+5Kq8E4AUhQBHyLfr71LSW1GOPO/tU+sqSS7Vn+9aNFi5is4uVTPrq56e288v5bMFKL6YTLPIzYlIJ/BkHABIlfFUKZgeQ==',key_name='tempest-keypair-1775800648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-z2eh0j5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=fb1eadc7-04dd-401d-b2dc-1abf8a598487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:25:44,bridge_name='br-int',has_traffic_filtering=True,id=97104eed-fe3e-4803-a457-978bfeba469f,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97104eed-fe') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'pci_devices' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:27:08 user nova-compute[71312]:   <uuid>fb1eadc7-04dd-401d-b2dc-1abf8a598487</uuid>
Apr 14 06:27:08 user nova-compute[71312]:   <name>instance-0000002c</name>
Apr 14 06:27:08 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:27:08 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:27:08 user nova-compute[71312]:   <metadata>
Apr 14 06:27:08 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:27:08 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:27:08 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-46421142</nova:name>
Apr 14 06:27:08 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:27:08</nova:creationTime>
Apr 14 06:27:08 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:27:08 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:27:08 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:27:08 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:27:08 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:27:08 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:27:08 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:27:08 user nova-compute[71312]:       <nova:owner>
Apr 14 06:27:08 user nova-compute[71312]:         <nova:user uuid="67c2d41a3a2e40a3bc67feafbfe4f5ca">tempest-ServerRescueNegativeTestJSON-140136450-project-member</nova:user>
Apr 14 06:27:08 user nova-compute[71312]:         <nova:project uuid="a6d89d9d942e49ecab2a2449b275fa7e">tempest-ServerRescueNegativeTestJSON-140136450</nova:project>
Apr 14 06:27:08 user nova-compute[71312]:       </nova:owner>
Apr 14 06:27:08 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:27:08 user nova-compute[71312]:       <nova:ports>
Apr 14 06:27:08 user nova-compute[71312]:         <nova:port uuid="97104eed-fe3e-4803-a457-978bfeba469f">
Apr 14 06:27:08 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 06:27:08 user nova-compute[71312]:         </nova:port>
Apr 14 06:27:08 user nova-compute[71312]:       </nova:ports>
Apr 14 06:27:08 user nova-compute[71312]:     </nova:instance>
Apr 14 06:27:08 user nova-compute[71312]:   </metadata>
Apr 14 06:27:08 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:27:08 user nova-compute[71312]:     <system>
Apr 14 06:27:08 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:27:08 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:27:08 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:27:08 user nova-compute[71312]:       <entry name="serial">fb1eadc7-04dd-401d-b2dc-1abf8a598487</entry>
Apr 14 06:27:08 user nova-compute[71312]:       <entry name="uuid">fb1eadc7-04dd-401d-b2dc-1abf8a598487</entry>
Apr 14 06:27:08 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:27:08 user nova-compute[71312]:     </system>
Apr 14 06:27:08 user nova-compute[71312]:   </sysinfo>
Apr 14 06:27:08 user nova-compute[71312]:   <os>
Apr 14 06:27:08 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:27:08 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:27:08 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:27:08 user nova-compute[71312]:   </os>
Apr 14 06:27:08 user nova-compute[71312]:   <features>
Apr 14 06:27:08 user nova-compute[71312]:     <acpi/>
Apr 14 06:27:08 user nova-compute[71312]:     <apic/>
Apr 14 06:27:08 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:27:08 user nova-compute[71312]:   </features>
Apr 14 06:27:08 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:27:08 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:27:08 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:27:08 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:27:08 user nova-compute[71312]:   </clock>
Apr 14 06:27:08 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:27:08 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:27:08 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:27:08 user nova-compute[71312]:   </cpu>
Apr 14 06:27:08 user nova-compute[71312]:   <devices>
Apr 14 06:27:08 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:27:08 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:27:08 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk"/>
Apr 14 06:27:08 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:27:08 user nova-compute[71312]:     </disk>
Apr 14 06:27:08 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:27:08 user nova-compute[71312]:       <mac address="fa:16:3e:2a:25:44"/>
Apr 14 06:27:08 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:27:08 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:27:08 user nova-compute[71312]:       <target dev="tap97104eed-fe"/>
Apr 14 06:27:08 user nova-compute[71312]:     </interface>
Apr 14 06:27:08 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:27:08 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/console.log" append="off"/>
Apr 14 06:27:08 user nova-compute[71312]:     </serial>
Apr 14 06:27:08 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:27:08 user nova-compute[71312]:     <video>
Apr 14 06:27:08 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:27:08 user nova-compute[71312]:     </video>
Apr 14 06:27:08 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:27:08 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:27:08 user nova-compute[71312]:     </rng>
Apr 14 06:27:08 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:27:08 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:27:08 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:27:08 user nova-compute[71312]:     </memballoon>
Apr 14 06:27:08 user nova-compute[71312]:   </devices>
Apr 14 06:27:08 user nova-compute[71312]: </domain>
Apr 14 06:27:08 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-46421142',display_name='tempest-ServerRescueNegativeTestJSON-server-46421142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-46421142',id=44,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmp+2NPOMTYQbC0TeVNV78xcjBhWnxOAAiz+5Kq8E4AUhQBHyLfr71LSW1GOPO/tU+sqSS7Vn+9aNFi5is4uVTPrq56e288v5bMFKL6YTLPIzYlIJ/BkHABIlfFUKZgeQ==',key_name='tempest-keypair-1775800648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-z2eh0j5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=fb1eadc7-04dd-401d-b2dc-1abf8a598487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:25:44,bridge_name='br-int',has_traffic_filtering=True,id=97104eed-fe3e-4803-a457-978bfeba469f,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97104eed-fe') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG os_vif [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:25:44,bridge_name='br-int',has_traffic_filtering=True,id=97104eed-fe3e-4803-a457-978bfeba469f,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97104eed-fe') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97104eed-fe, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97104eed-fe, col_values=(('external_ids', {'iface-id': '97104eed-fe3e-4803-a457-978bfeba469f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:25:44', 'vm-uuid': 'fb1eadc7-04dd-401d-b2dc-1abf8a598487'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:08 user nova-compute[71312]: INFO os_vif [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:25:44,bridge_name='br-int',has_traffic_filtering=True,id=97104eed-fe3e-4803-a457-978bfeba469f,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97104eed-fe')
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No VIF found with MAC fa:16:3e:2a:25:44, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updated VIF entry in instance network info cache for port 97104eed-fe3e-4803-a457-978bfeba469f. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG nova.network.neutron [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:27:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:27:09 user nova-compute[71312]: WARNING nova.compute.manager [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state building and task_state spawning.
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453631.792715, fb1eadc7-04dd-401d-b2dc-1abf8a598487 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:27:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] VM Resumed (Lifecycle Event)
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:27:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance spawned successfully.
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:27:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453631.7941184, fb1eadc7-04dd-401d-b2dc-1abf8a598487 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:27:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] VM Started (Lifecycle Event)
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:27:11 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:27:11 user nova-compute[71312]: INFO nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Took 5.75 seconds to spawn the instance on the hypervisor.
Apr 14 06:27:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:27:11 user nova-compute[71312]: INFO nova.compute.manager [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Took 6.30 seconds to build instance.
Apr 14 06:27:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.416s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:27:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:27:12 user nova-compute[71312]: WARNING nova.compute.manager [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state active and task_state None.
Apr 14 06:27:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:27:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:27:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:27:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:27:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:34 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:34 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:35 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:27:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:27:36 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=26.056617736816406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:27:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:27:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:40 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:27:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:27:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:27:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:27:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:27:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:27:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:27:46 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:27:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:27:46 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:27:46 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:27:47 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:27:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:27:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:27:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:27:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:27:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:27:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:27:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:27:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:27:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:27:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:28:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:28:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:28:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:28:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:28:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:28:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:28:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:28:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:28:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:28:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:28:36 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:36 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:28:38 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=26.056015014648438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:28:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:28:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:28:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:28:48 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:28:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:28:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:28:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:28:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:28:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:28:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:28:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:28:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-changed-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Refreshing instance network info cache due to event network-changed-97104eed-fe3e-4803-a457-978bfeba469f. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Refreshing network info cache for port 97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'flavor' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updated VIF entry in instance network info cache for port 97104eed-fe3e-4803-a457-978bfeba469f. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:28:56 user nova-compute[71312]: DEBUG nova.network.neutron [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:28:57 user nova-compute[71312]: INFO nova.compute.manager [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Attaching volume b8a7e32f-932b-4a35-9446-4e329f0bfe5d to /dev/vdb
Apr 14 06:28:57 user nova-compute[71312]: DEBUG os_brick.utils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[67677d96-3927-4cae-907c-0175e8fb6808]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c67692-b1d3-413a-aab9-6f03568a8653]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b379689-f132-44b8-9168-335f0008928a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe9c1c1-4afe-4730-96d1-9a87d4c19a80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:28:57 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe258f90-6036-4f9b-8bcb-bea968282d80]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG os_brick.utils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating existing volume attachment record: 4de53c8e-81f5-484d-a93e-271e335bf5c9 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:28:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:28:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkTvmgMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:29:01 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:29:01 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:29:01 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eebb82-861c-4938-bfec-d45295b60087]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:29:01 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76f9c2-7f1b-43b6-b8fa-bb637aaecbaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d] added
Apr 14 06:29:01 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c879cce-dd66-4518-9cea-2cbd9636afef]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[558fcacb-7b81-4e5b-a85f-a62f8ba1b942]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkTvmgMa {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkTvmgMa" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fc1b14-090d-4bf1-ae5b-00eacce20266]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OkTvmgMa'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaac329-7204-4fd2-9d50-11dbc218201b]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfbeaba-1368-4dda-891b-117f6f8caaa9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:29:01 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:29:01 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:29:01 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 06:29:01 user nova-compute[71312]: 
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d3d3a-341c-4066-b585-13b3a56e1cd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d, portal: 172.16.0.220,3260]
Apr 14 06:29:01 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d, portal: 172.16.0.220,3260] successful.
Apr 14 06:29:01 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a108b00-35e7-4bf1-bbfd-17d9b06b7dc0]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a6c3d-6dac-4a51-b670-fc823a48c604]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d (non-flash)
Apr 14 06:29:01 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d (non-flash)
Apr 14 06:29:01 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:29:01 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:02 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:02 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[113e3164-0770-4462-ae23-0af924cd7fc9]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:29:02 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:29:02 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkTvmgMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:29:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23562613633316436', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562613633316436', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'flavor' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 06:29:03 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:29:03 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:29:03 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:29:03 user nova-compute[71312]:   <serial>b8a7e32f-932b-4a35-9446-4e329f0bfe5d</serial>
Apr 14 06:29:03 user nova-compute[71312]: </disk>
Apr 14 06:29:03 user nova-compute[71312]:  {{(pid=71312) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No VIF found with MAC fa:16:3e:2a:25:44, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:29:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.504s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:04 user nova-compute[71312]: INFO nova.compute.manager [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Rescuing
Apr 14 06:29:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:29:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:29:04 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG nova.network.neutron [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG nova.compute.manager [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:29:05 user nova-compute[71312]: WARNING nova.compute.manager [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state active and task_state rescuing.
Apr 14 06:29:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance destroyed successfully.
Apr 14 06:29:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Attempting rescue
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71312) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance directory exists: not creating {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 06:29:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Creating image(s)
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue" returned: 0 in 0.055s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'migration_context' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Start _get_guest_xml network_info=[{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:2a:25:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'resources' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'numa_topology' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:29:06 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:29:06 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-46421142',display_name='tempest-ServerRescueNegativeTestJSON-server-46421142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-46421142',id=44,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmp+2NPOMTYQbC0TeVNV78xcjBhWnxOAAiz+5Kq8E4AUhQBHyLfr71LSW1GOPO/tU+sqSS7Vn+9aNFi5is4uVTPrq56e288v5bMFKL6YTLPIzYlIJ/BkHABIlfFUKZgeQ==',key_name='tempest-keypair-1775800648',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-z2eh0j5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=fb1eadc7-04dd-401d-b2dc-1abf8a598487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:2a:25:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "vif_mac": "fa:16:3e:2a:25:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:25:44,bridge_name='br-int',has_traffic_filtering=True,id=97104eed-fe3e-4803-a457-978bfeba469f,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97104eed-fe') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.objects.instance [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'pci_devices' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:29:06 user nova-compute[71312]:   <uuid>fb1eadc7-04dd-401d-b2dc-1abf8a598487</uuid>
Apr 14 06:29:06 user nova-compute[71312]:   <name>instance-0000002c</name>
Apr 14 06:29:06 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:29:06 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:29:06 user nova-compute[71312]:   <metadata>
Apr 14 06:29:06 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:29:06 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:29:06 user nova-compute[71312]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-46421142</nova:name>
Apr 14 06:29:06 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:29:06</nova:creationTime>
Apr 14 06:29:06 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:29:06 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:29:06 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:29:06 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:29:06 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:29:06 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:29:06 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:29:06 user nova-compute[71312]:       <nova:owner>
Apr 14 06:29:06 user nova-compute[71312]:         <nova:user uuid="67c2d41a3a2e40a3bc67feafbfe4f5ca">tempest-ServerRescueNegativeTestJSON-140136450-project-member</nova:user>
Apr 14 06:29:06 user nova-compute[71312]:         <nova:project uuid="a6d89d9d942e49ecab2a2449b275fa7e">tempest-ServerRescueNegativeTestJSON-140136450</nova:project>
Apr 14 06:29:06 user nova-compute[71312]:       </nova:owner>
Apr 14 06:29:06 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:29:06 user nova-compute[71312]:       <nova:ports>
Apr 14 06:29:06 user nova-compute[71312]:         <nova:port uuid="97104eed-fe3e-4803-a457-978bfeba469f">
Apr 14 06:29:06 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 06:29:06 user nova-compute[71312]:         </nova:port>
Apr 14 06:29:06 user nova-compute[71312]:       </nova:ports>
Apr 14 06:29:06 user nova-compute[71312]:     </nova:instance>
Apr 14 06:29:06 user nova-compute[71312]:   </metadata>
Apr 14 06:29:06 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:29:06 user nova-compute[71312]:     <system>
Apr 14 06:29:06 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:29:06 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:29:06 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:29:06 user nova-compute[71312]:       <entry name="serial">fb1eadc7-04dd-401d-b2dc-1abf8a598487</entry>
Apr 14 06:29:06 user nova-compute[71312]:       <entry name="uuid">fb1eadc7-04dd-401d-b2dc-1abf8a598487</entry>
Apr 14 06:29:06 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:29:06 user nova-compute[71312]:     </system>
Apr 14 06:29:06 user nova-compute[71312]:   </sysinfo>
Apr 14 06:29:06 user nova-compute[71312]:   <os>
Apr 14 06:29:06 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:29:06 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:29:06 user nova-compute[71312]:   </os>
Apr 14 06:29:06 user nova-compute[71312]:   <features>
Apr 14 06:29:06 user nova-compute[71312]:     <acpi/>
Apr 14 06:29:06 user nova-compute[71312]:     <apic/>
Apr 14 06:29:06 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:29:06 user nova-compute[71312]:   </features>
Apr 14 06:29:06 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:29:06 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:29:06 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:29:06 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:29:06 user nova-compute[71312]:   </clock>
Apr 14 06:29:06 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:29:06 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:29:06 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:29:06 user nova-compute[71312]:   </cpu>
Apr 14 06:29:06 user nova-compute[71312]:   <devices>
Apr 14 06:29:06 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:29:06 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:29:06 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue"/>
Apr 14 06:29:06 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:29:06 user nova-compute[71312]:     </disk>
Apr 14 06:29:06 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:29:06 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:29:06 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk"/>
Apr 14 06:29:06 user nova-compute[71312]:       <target dev="vdb" bus="virtio"/>
Apr 14 06:29:06 user nova-compute[71312]:     </disk>
Apr 14 06:29:06 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:29:06 user nova-compute[71312]:       <mac address="fa:16:3e:2a:25:44"/>
Apr 14 06:29:06 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:29:06 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:29:06 user nova-compute[71312]:       <target dev="tap97104eed-fe"/>
Apr 14 06:29:06 user nova-compute[71312]:     </interface>
Apr 14 06:29:06 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:29:06 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/console.log" append="off"/>
Apr 14 06:29:06 user nova-compute[71312]:     </serial>
Apr 14 06:29:06 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:29:06 user nova-compute[71312]:     <video>
Apr 14 06:29:06 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:29:06 user nova-compute[71312]:     </video>
Apr 14 06:29:06 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:29:06 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:29:06 user nova-compute[71312]:     </rng>
Apr 14 06:29:06 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:29:06 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:29:06 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:29:06 user nova-compute[71312]:     </memballoon>
Apr 14 06:29:06 user nova-compute[71312]:   </devices>
Apr 14 06:29:06 user nova-compute[71312]: </domain>
Apr 14 06:29:06 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:29:06 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance destroyed successfully.
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:29:06 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] No VIF found with MAC fa:16:3e:2a:25:44, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:29:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:29:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:29:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:29:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:07 user nova-compute[71312]: DEBUG nova.compute.manager [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:29:07 user nova-compute[71312]: WARNING nova.compute.manager [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state active and task_state rescuing.
Apr 14 06:29:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:29:09 user nova-compute[71312]: WARNING nova.compute.manager [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state active and task_state rescuing.
Apr 14 06:29:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:29:09 user nova-compute[71312]: WARNING nova.compute.manager [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state active and task_state rescuing.
Apr 14 06:29:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for fb1eadc7-04dd-401d-b2dc-1abf8a598487 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:29:10 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453750.107934, fb1eadc7-04dd-401d-b2dc-1abf8a598487 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:29:10 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] VM Resumed (Lifecycle Event)
Apr 14 06:29:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:29:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:29:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:29:10 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 06:29:10 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453750.1090071, fb1eadc7-04dd-401d-b2dc-1abf8a598487 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:29:10 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] VM Started (Lifecycle Event)
Apr 14 06:29:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:29:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:29:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:31 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:29:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:29:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:29:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:29:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:29:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=26.035480499267578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:29:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:29:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:29:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:29:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:29:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:29:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:29:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:29:49 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:29:50 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:29:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:29:50 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:29:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:29:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:29:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:30:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:30:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:33 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:35 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:30:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:30:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:30:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:30:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:30:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:30:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:30:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=26.034896850585938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:30:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:30:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:30:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:45 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:30:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:30:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:30:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:30:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:30:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:30:51 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:30:51 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:30:52 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:30:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:30:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:30:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:30:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:30:55 user nova-compute[71312]: INFO nova.compute.manager [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Unrescuing
Apr 14 06:30:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:30:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:30:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:30:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:30:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:30:56 user nova-compute[71312]: DEBUG nova.objects.instance [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'flavor' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:30:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:30:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:30:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:30:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:30:57 user nova-compute[71312]: DEBUG nova.compute.manager [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:30:57 user nova-compute[71312]: WARNING nova.compute.manager [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:30:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:57 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance destroyed successfully.
Apr 14 06:30:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:30:59 user nova-compute[71312]: WARNING nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:30:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:30:59 user nova-compute[71312]: WARNING nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:30:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:30:59 user nova-compute[71312]: DEBUG nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:30:59 user nova-compute[71312]: WARNING nova.compute.manager [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state rescued and task_state unrescuing.
Apr 14 06:30:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:00 user nova-compute[71312]: DEBUG nova.virt.libvirt.host [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Removed pending event for fb1eadc7-04dd-401d-b2dc-1abf8a598487 due to event {{(pid=71312) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 06:31:00 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453860.8198695, fb1eadc7-04dd-401d-b2dc-1abf8a598487 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:31:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] VM Resumed (Lifecycle Event)
Apr 14 06:31:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:31:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:31:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:31:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 06:31:00 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681453860.827012, fb1eadc7-04dd-401d-b2dc-1abf8a598487 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:31:00 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] VM Started (Lifecycle Event)
Apr 14 06:31:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:31:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:31:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:31:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:31:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:31:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:31:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:31:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:31:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:31:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:31:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:31:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:31:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:31:37 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:31:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:31:38 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:31:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:31:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=26.052345275878906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:31:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:31:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:31:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:47 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:31:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:31:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:31:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:31:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:31:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:31:53 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:31:54 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [{"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:31:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-6cf8ae21-6690-4390-9990-690333025c17" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:31:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:31:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:32:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:32:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:32:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:32:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:32:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:32:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:32:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:32:39 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:32:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:39 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:40 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:32:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:32:41 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8662MB free_disk=26.051734924316406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:32:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:32:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-changed-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.compute.manager [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Refreshing instance network info cache due to event network-changed-97104eed-fe3e-4803-a457-978bfeba469f. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Refreshing network info cache for port 97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:32:47 user nova-compute[71312]: INFO nova.compute.manager [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Detaching volume b8a7e32f-932b-4a35-9446-4e329f0bfe5d
Apr 14 06:32:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:47 user nova-compute[71312]: INFO nova.virt.block_device [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Attempting to driver detach volume b8a7e32f-932b-4a35-9446-4e329f0bfe5d from mountpoint /dev/vdb
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Attempting to detach device vdb from instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 from the persistent domain config. {{(pid=71312) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:32:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:32:47 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:32:47 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:32:47 user nova-compute[71312]:   <serial>b8a7e32f-932b-4a35-9446-4e329f0bfe5d</serial>
Apr 14 06:32:47 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:32:47 user nova-compute[71312]: </disk>
Apr 14 06:32:47 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:32:47 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Successfully detached device vdb from instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 from the persistent domain config.
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 from the live domain config. {{(pid=71312) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.virt.libvirt.guest [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 06:32:47 user nova-compute[71312]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:32:47 user nova-compute[71312]:   <source dev="/dev/sdb"/>
Apr 14 06:32:47 user nova-compute[71312]:   <target dev="vdb" bus="virtio"/>
Apr 14 06:32:47 user nova-compute[71312]:   <serial>b8a7e32f-932b-4a35-9446-4e329f0bfe5d</serial>
Apr 14 06:32:47 user nova-compute[71312]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 06:32:47 user nova-compute[71312]: </disk>
Apr 14 06:32:47 user nova-compute[71312]:  {{(pid=71312) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updated VIF entry in instance network info cache for port 97104eed-fe3e-4803-a457-978bfeba469f. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG nova.network.neutron [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:32:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Received event <DeviceRemovedEvent: 1681453968.3263135, fb1eadc7-04dd-401d-b2dc-1abf8a598487 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71312) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 06:32:48 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Successfully detached device vdb from instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 from the live domain config.
Apr 14 06:32:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkTvmgMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:32:48 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7992677-e397-4489-946d-175089dae4f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:32:48 user nova-compute[71312]: No targets found.
Apr 14 06:32:48 user nova-compute[71312]: iSNS:
Apr 14 06:32:48 user nova-compute[71312]: No targets found.
Apr 14 06:32:48 user nova-compute[71312]: STATIC:
Apr 14 06:32:48 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d
Apr 14 06:32:48 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:32:48 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:32:48 user nova-compute[71312]: FIRMWARE:
Apr 14 06:32:48 user nova-compute[71312]: No targets found.
Apr 14 06:32:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:32:48 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:32:48 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e6e118-0ce4-4a75-a549-0bcf8d91bfb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31a3f82-5e39-43ea-b92e-93b92682ed26]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d (non-flash)
Apr 14 06:32:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d (non-flash)
Apr 14 06:32:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc1ad000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64e2b5e-f8c6-4bdf-b394-30541b8fe39e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e8a150-22a7-49b7-91bd-473b30a91793]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[29739543-359a-4b53-a774-6c94398432f3]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2f932d-cef1-4553-b69b-02442e89c465]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170bff2-eb9f-4a18-85a5-321e809e91d9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7690138c-83c7-482a-b0cc-a775f2e4f9e6]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d, portal: 172.16.0.220,3260]
Apr 14 06:32:48 user nova-compute[71312]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d, portal: 172.16.0.220,3260] successful.
Apr 14 06:32:48 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a7e32f-932b-4a35-9446-4e329f0bfe5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb90b20-7fc8-46c2-bd7f-885b5b537cb1]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] <== disconnect_volume: return (294ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:32:48 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG nova.objects.instance [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'flavor' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.689s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-changed-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG nova.compute.manager [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Refreshing instance network info cache due to event network-changed-97104eed-fe3e-4803-a457-978bfeba469f. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Refreshing network info cache for port 97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updated VIF entry in instance network info cache for port 97104eed-fe3e-4803-a457-978bfeba469f. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG nova.network.neutron [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:32:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:32:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:52 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:32:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:55 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:32:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:32:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:32:55 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:32:56 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [{"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:32:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-fb1eadc7-04dd-401d-b2dc-1abf8a598487" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:32:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:32:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:32:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:32:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:32:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:32:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:32:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:33:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:33:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:33:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:33:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:34 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:33:38 user nova-compute[71312]: INFO nova.compute.manager [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Terminating instance
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-unplugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Instance destroyed successfully.
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.objects.instance [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'resources' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-46421142',display_name='tempest-ServerRescueNegativeTestJSON-server-46421142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-46421142',id=44,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmp+2NPOMTYQbC0TeVNV78xcjBhWnxOAAiz+5Kq8E4AUhQBHyLfr71LSW1GOPO/tU+sqSS7Vn+9aNFi5is4uVTPrq56e288v5bMFKL6YTLPIzYlIJ/BkHABIlfFUKZgeQ==',key_name='tempest-keypair-1775800648',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:29:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-z2eh0j5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=fb1eadc7-04dd-401d-b2dc-1abf8a598487,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "97104eed-fe3e-4803-a457-978bfeba469f", "address": "fa:16:3e:2a:25:44", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97104eed-fe", "ovs_interfaceid": "97104eed-fe3e-4803-a457-978bfeba469f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:25:44,bridge_name='br-int',has_traffic_filtering=True,id=97104eed-fe3e-4803-a457-978bfeba469f,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97104eed-fe') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG os_vif [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:25:44,bridge_name='br-int',has_traffic_filtering=True,id=97104eed-fe3e-4803-a457-978bfeba469f,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97104eed-fe') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97104eed-fe, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:38 user nova-compute[71312]: INFO os_vif [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:25:44,bridge_name='br-int',has_traffic_filtering=True,id=97104eed-fe3e-4803-a457-978bfeba469f,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97104eed-fe')
Apr 14 06:33:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Deleting instance files /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487_del
Apr 14 06:33:38 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Deletion of /opt/stack/data/nova/instances/fb1eadc7-04dd-401d-b2dc-1abf8a598487_del complete
Apr 14 06:33:38 user nova-compute[71312]: INFO nova.compute.manager [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 14 06:33:38 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:33:38 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:33:39 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Took 0.70 seconds to deallocate network for instance.
Apr 14 06:33:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:33:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:33:40 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Deleted allocations for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487
Apr 14 06:33:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:33:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:33:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Acquiring lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:33:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:33:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Lock "fb1eadc7-04dd-401d-b2dc-1abf8a598487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:33:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] No waiting events found dispatching network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:33:40 user nova-compute[71312]: WARNING nova.compute.manager [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received unexpected event network-vif-plugged-97104eed-fe3e-4803-a457-978bfeba469f for instance with vm_state deleted and task_state None.
Apr 14 06:33:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Received event network-vif-deleted-97104eed-fe3e-4803-a457-978bfeba469f {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:33:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:33:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:33:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:33:41 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:33:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:33:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:33:41 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:33:42 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:33:43 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:33:43 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:33:43 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=26.062808990478516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 6cf8ae21-6690-4390-9990-690333025c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:33:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:33:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:33:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:33:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:51 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:33:53 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681454018.820053, fb1eadc7-04dd-401d-b2dc-1abf8a598487 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:33:53 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] VM Stopped (Lifecycle Event)
Apr 14 06:33:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-e60546e8-b168-47eb-9be7-971a80f199ba None None] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:33:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:33:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:33:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:33:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:33:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:33:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:33:57 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:33:57 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:33:58 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [{"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:33:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-edc258d3-78b8-4f61-a648-6452dcc62355" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:33:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:33:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:34:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "edc258d3-78b8-4f61-a648-6452dcc62355" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "6cf8ae21-6690-4390-9990-690333025c17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "edc258d3-78b8-4f61-a648-6452dcc62355" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "6cf8ae21-6690-4390-9990-690333025c17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:34:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:34:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:34:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:34:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:34:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:34:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "6cf8ae21-6690-4390-9990-690333025c17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:38 user nova-compute[71312]: INFO nova.compute.manager [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Terminating instance
Apr 14 06:34:38 user nova-compute[71312]: DEBUG nova.compute.manager [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-unplugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] No waiting events found dispatching network-vif-unplugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG nova.compute.manager [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-unplugged-47437095-940c-4fcc-bc27-5c8698e99a59 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:34:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Instance destroyed successfully.
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.objects.instance [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'resources' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-897572158',display_name='tempest-ServerRescueNegativeTestJSON-server-897572158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-897572158',id=42,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:20:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-o79m09fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:20:30Z,user_data=None,user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=6cf8ae21-6690-4390-9990-690333025c17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "47437095-940c-4fcc-bc27-5c8698e99a59", "address": "fa:16:3e:e8:81:65", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47437095-94", "ovs_interfaceid": "47437095-940c-4fcc-bc27-5c8698e99a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:81:65,bridge_name='br-int',has_traffic_filtering=True,id=47437095-940c-4fcc-bc27-5c8698e99a59,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47437095-94') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG os_vif [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:81:65,bridge_name='br-int',has_traffic_filtering=True,id=47437095-940c-4fcc-bc27-5c8698e99a59,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47437095-94') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47437095-94, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:34:39 user nova-compute[71312]: INFO os_vif [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:81:65,bridge_name='br-int',has_traffic_filtering=True,id=47437095-940c-4fcc-bc27-5c8698e99a59,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47437095-94')
Apr 14 06:34:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Deleting instance files /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17_del
Apr 14 06:34:39 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Deletion of /opt/stack/data/nova/instances/6cf8ae21-6690-4390-9990-690333025c17_del complete
Apr 14 06:34:39 user nova-compute[71312]: INFO nova.compute.manager [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 06:34:39 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:34:39 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Took 0.59 seconds to deallocate network for instance.
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-37d6e992-6a78-4be6-8efd-de7d7a2efe55 req-ed7f5b8d-d300-4cd3-87e6-0cebcac15716 service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-deleted-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:34:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:40 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Deleted allocations for instance 6cf8ae21-6690-4390-9990-690333025c17
Apr 14 06:34:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "6cf8ae21-6690-4390-9990-690333025c17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:34:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] Acquiring lock "6cf8ae21-6690-4390-9990-690333025c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] Lock "6cf8ae21-6690-4390-9990-690333025c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:40 user nova-compute[71312]: DEBUG nova.compute.manager [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] No waiting events found dispatching network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:34:40 user nova-compute[71312]: WARNING nova.compute.manager [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Received unexpected event network-vif-plugged-47437095-940c-4fcc-bc27-5c8698e99a59 for instance with vm_state deleted and task_state None.
Apr 14 06:34:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:43 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:34:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:34:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:34:43 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:44 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:34:44 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:34:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=26.10055923461914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance edc258d3-78b8-4f61-a648-6452dcc62355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:34:44 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:34:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:53 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:34:54 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681454079.0965168, 6cf8ae21-6690-4390-9990-690333025c17 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:34:54 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 6cf8ae21-6690-4390-9990-690333025c17] VM Stopped (Lifecycle Event)
Apr 14 06:34:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-4ea8f264-8dba-40eb-93a9-1449aae62615 None None] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:34:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:34:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:34:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:35:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:35:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:35:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:35:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:35:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:35:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:35:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "edc258d3-78b8-4f61-a648-6452dcc62355" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:35:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:35:28 user nova-compute[71312]: INFO nova.compute.manager [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Terminating instance
Apr 14 06:35:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-unplugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Instance destroyed successfully.
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'resources' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1264137081',display_name='tempest-ServerRescueNegativeTestJSON-server-1264137081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1264137081',id=41,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d89d9d942e49ecab2a2449b275fa7e',ramdisk_id='',reservation_id='r-kkk93xhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-140136450',owner_user_name='tempest-ServerRescueNegativeTestJSON-140136450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:25:13Z,user_data=None,user_id='67c2d41a3a2e40a3bc67feafbfe4f5ca',uuid=edc258d3-78b8-4f61-a648-6452dcc62355,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converting VIF {"id": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "address": "fa:16:3e:ca:98:b5", "network": {"id": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1977235768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d89d9d942e49ecab2a2449b275fa7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f7f3c2e-3e", "ovs_interfaceid": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7f3c2e-3e') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG os_vif [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7f3c2e-3e') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f7f3c2e-3e, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:29 user nova-compute[71312]: INFO os_vif [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230,network=Network(fa1bd7e5-13e4-45fc-bb2a-6455917df1a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f7f3c2e-3e')
Apr 14 06:35:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Deleting instance files /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355_del
Apr 14 06:35:29 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Deletion of /opt/stack/data/nova/instances/edc258d3-78b8-4f61-a648-6452dcc62355_del complete
Apr 14 06:35:29 user nova-compute[71312]: INFO nova.compute.manager [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 14 06:35:29 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:35:29 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:35:30 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:35:30 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Took 0.47 seconds to deallocate network for instance.
Apr 14 06:35:30 user nova-compute[71312]: DEBUG nova.compute.manager [req-26cf8243-1d5e-42b0-9a21-896f118ed7dd req-50d44905-b956-44f0-8b81-308582c9c8a4 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-deleted-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:35:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:35:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:35:30 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:35:30 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:35:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:35:30 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Deleted allocations for instance edc258d3-78b8-4f61-a648-6452dcc62355
Apr 14 06:35:30 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "edc258d3-78b8-4f61-a648-6452dcc62355" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.432s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:35:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:35:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] Acquiring lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:35:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:35:31 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] Lock "edc258d3-78b8-4f61-a648-6452dcc62355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:35:31 user nova-compute[71312]: DEBUG nova.compute.manager [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] No waiting events found dispatching network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:35:31 user nova-compute[71312]: WARNING nova.compute.manager [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Received unexpected event network-vif-plugged-6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance with vm_state deleted and task_state None.
Apr 14 06:35:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:38 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:40 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:44 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681454129.5125315, edc258d3-78b8-4f61-a648-6452dcc62355 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:35:44 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] VM Stopped (Lifecycle Event)
Apr 14 06:35:44 user nova-compute[71312]: DEBUG nova.compute.manager [None req-fbc3c062-ef3c-431d-a4f9-4ff9bccea4a7 None None] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:35:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:35:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:35:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:35:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:35:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:35:45 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:35:45 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:35:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:35:46 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:35:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=26.11969757080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:35:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:35:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:35:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:35:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:35:46 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:35:46 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:35:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:35:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:35:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:35:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:35:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:35:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:35:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:35:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:35:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:35:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:35:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:35:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:35:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:36:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:36:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:36:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:36:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:36:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:36:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:36:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:36:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:36:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "4b290e1c-9913-40a0-b56a-cff34ac136d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:36:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:36 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:36 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:36:36 user nova-compute[71312]: INFO nova.compute.claims [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Claim successful on node user
Apr 14 06:36:36 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:36:36 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:36:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.policy [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac6e9308389d4a2e82c417129f92b61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c26ec94b6b8430c93f18d63ff4991f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:36:37 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Creating image(s)
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "/opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "/opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.184s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.144s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk 1073741824" returned: 0 in 0.055s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.152s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Cannot resize image /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:36:37 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lazy-loading 'migration_context' on Instance uuid 4b290e1c-9913-40a0-b56a-cff34ac136d5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:36:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:36:38 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Ensure instance console log exists: /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:36:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:38 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:38 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Successfully created port: a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Successfully updated port: a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquired lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received event network-changed-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.compute.manager [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Refreshing instance network info cache due to event network-changed-a60861bc-2377-4a40-87be-e251f3f8e4bb. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] Acquiring lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.network.neutron [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Updating instance_info_cache with network_info: [{"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Releasing lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Instance network_info: |[{"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] Acquired lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.network.neutron [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Refreshing network info cache for port a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Start _get_guest_xml network_info=[{"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:36:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:36:39 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:36:39 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1376031392',display_name='tempest-VolumesActionsTest-instance-1376031392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1376031392',id=45,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c26ec94b6b8430c93f18d63ff4991f6',ramdisk_id='',reservation_id='r-teajfei6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1517089725',owner_user_name='tempest-VolumesActionsTest-1517089725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:36:37Z,user_data=None,user_id='ac6e9308389d4a2e82c417129f92b61f',uuid=4b290e1c-9913-40a0-b56a-cff34ac136d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converting VIF {"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=a60861bc-2377-4a40-87be-e251f3f8e4bb,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60861bc-23') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.objects.instance [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b290e1c-9913-40a0-b56a-cff34ac136d5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:36:40 user nova-compute[71312]:   <uuid>4b290e1c-9913-40a0-b56a-cff34ac136d5</uuid>
Apr 14 06:36:40 user nova-compute[71312]:   <name>instance-0000002d</name>
Apr 14 06:36:40 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:36:40 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:36:40 user nova-compute[71312]:   <metadata>
Apr 14 06:36:40 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:36:40 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:36:40 user nova-compute[71312]:       <nova:name>tempest-VolumesActionsTest-instance-1376031392</nova:name>
Apr 14 06:36:40 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:36:39</nova:creationTime>
Apr 14 06:36:40 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:36:40 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:36:40 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:36:40 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:36:40 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:36:40 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:36:40 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:36:40 user nova-compute[71312]:       <nova:owner>
Apr 14 06:36:40 user nova-compute[71312]:         <nova:user uuid="ac6e9308389d4a2e82c417129f92b61f">tempest-VolumesActionsTest-1517089725-project-member</nova:user>
Apr 14 06:36:40 user nova-compute[71312]:         <nova:project uuid="4c26ec94b6b8430c93f18d63ff4991f6">tempest-VolumesActionsTest-1517089725</nova:project>
Apr 14 06:36:40 user nova-compute[71312]:       </nova:owner>
Apr 14 06:36:40 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:36:40 user nova-compute[71312]:       <nova:ports>
Apr 14 06:36:40 user nova-compute[71312]:         <nova:port uuid="a60861bc-2377-4a40-87be-e251f3f8e4bb">
Apr 14 06:36:40 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 06:36:40 user nova-compute[71312]:         </nova:port>
Apr 14 06:36:40 user nova-compute[71312]:       </nova:ports>
Apr 14 06:36:40 user nova-compute[71312]:     </nova:instance>
Apr 14 06:36:40 user nova-compute[71312]:   </metadata>
Apr 14 06:36:40 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:36:40 user nova-compute[71312]:     <system>
Apr 14 06:36:40 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:36:40 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:36:40 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:36:40 user nova-compute[71312]:       <entry name="serial">4b290e1c-9913-40a0-b56a-cff34ac136d5</entry>
Apr 14 06:36:40 user nova-compute[71312]:       <entry name="uuid">4b290e1c-9913-40a0-b56a-cff34ac136d5</entry>
Apr 14 06:36:40 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:36:40 user nova-compute[71312]:     </system>
Apr 14 06:36:40 user nova-compute[71312]:   </sysinfo>
Apr 14 06:36:40 user nova-compute[71312]:   <os>
Apr 14 06:36:40 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:36:40 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:36:40 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:36:40 user nova-compute[71312]:   </os>
Apr 14 06:36:40 user nova-compute[71312]:   <features>
Apr 14 06:36:40 user nova-compute[71312]:     <acpi/>
Apr 14 06:36:40 user nova-compute[71312]:     <apic/>
Apr 14 06:36:40 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:36:40 user nova-compute[71312]:   </features>
Apr 14 06:36:40 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:36:40 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:36:40 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:36:40 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:36:40 user nova-compute[71312]:   </clock>
Apr 14 06:36:40 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:36:40 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:36:40 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:36:40 user nova-compute[71312]:   </cpu>
Apr 14 06:36:40 user nova-compute[71312]:   <devices>
Apr 14 06:36:40 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:36:40 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:36:40 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk"/>
Apr 14 06:36:40 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:36:40 user nova-compute[71312]:     </disk>
Apr 14 06:36:40 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:36:40 user nova-compute[71312]:       <mac address="fa:16:3e:34:f9:3e"/>
Apr 14 06:36:40 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:36:40 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:36:40 user nova-compute[71312]:       <target dev="tapa60861bc-23"/>
Apr 14 06:36:40 user nova-compute[71312]:     </interface>
Apr 14 06:36:40 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:36:40 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/console.log" append="off"/>
Apr 14 06:36:40 user nova-compute[71312]:     </serial>
Apr 14 06:36:40 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:36:40 user nova-compute[71312]:     <video>
Apr 14 06:36:40 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:36:40 user nova-compute[71312]:     </video>
Apr 14 06:36:40 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:36:40 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:36:40 user nova-compute[71312]:     </rng>
Apr 14 06:36:40 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:36:40 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:36:40 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:36:40 user nova-compute[71312]:     </memballoon>
Apr 14 06:36:40 user nova-compute[71312]:   </devices>
Apr 14 06:36:40 user nova-compute[71312]: </domain>
Apr 14 06:36:40 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1376031392',display_name='tempest-VolumesActionsTest-instance-1376031392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1376031392',id=45,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c26ec94b6b8430c93f18d63ff4991f6',ramdisk_id='',reservation_id='r-teajfei6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1517089725',owner_user_name='tempest-VolumesActionsTest-1517089725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:36:37Z,user_data=None,user_id='ac6e9308389d4a2e82c417129f92b61f',uuid=4b290e1c-9913-40a0-b56a-cff34ac136d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converting VIF {"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=a60861bc-2377-4a40-87be-e251f3f8e4bb,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60861bc-23') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG os_vif [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=a60861bc-2377-4a40-87be-e251f3f8e4bb,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60861bc-23') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa60861bc-23, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa60861bc-23, col_values=(('external_ids', {'iface-id': 'a60861bc-2377-4a40-87be-e251f3f8e4bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:f9:3e', 'vm-uuid': '4b290e1c-9913-40a0-b56a-cff34ac136d5'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:40 user nova-compute[71312]: INFO os_vif [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=a60861bc-2377-4a40-87be-e251f3f8e4bb,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60861bc-23')
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] No VIF found with MAC fa:16:3e:34:f9:3e, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Updated VIF entry in instance network info cache for port a60861bc-2377-4a40-87be-e251f3f8e4bb. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG nova.network.neutron [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Updating instance_info_cache with network_info: [{"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:36:40 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] Releasing lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received event network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] Acquiring lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:41 user nova-compute[71312]: DEBUG nova.compute.manager [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] No waiting events found dispatching network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:36:41 user nova-compute[71312]: WARNING nova.compute.manager [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received unexpected event network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb for instance with vm_state building and task_state spawning.
Apr 14 06:36:42 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681454203.5391755, 4b290e1c-9913-40a0-b56a-cff34ac136d5 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:36:43 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] VM Resumed (Lifecycle Event)
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:36:43 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Instance spawned successfully.
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:36:43 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681454203.540516, 4b290e1c-9913-40a0-b56a-cff34ac136d5 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:36:43 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] VM Started (Lifecycle Event)
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:36:43 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:36:43 user nova-compute[71312]: INFO nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received event network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] Acquiring lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:43 user nova-compute[71312]: DEBUG nova.compute.manager [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] No waiting events found dispatching network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:36:43 user nova-compute[71312]: WARNING nova.compute.manager [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received unexpected event network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb for instance with vm_state building and task_state spawning.
Apr 14 06:36:43 user nova-compute[71312]: INFO nova.compute.manager [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Took 6.97 seconds to build instance.
Apr 14 06:36:43 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.143s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:45 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:46 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:46 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:36:46 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:36:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:36:47 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:36:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=25.53540802001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:36:47 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:36:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:36:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:36:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:36:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:36:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:36:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:36:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:36:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:36:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 4b290e1c-9913-40a0-b56a-cff34ac136d5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:37:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:00 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Updating instance_info_cache with network_info: [{"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:37:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:37:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:37:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:37:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:37:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:37:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:37:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:37:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:39 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:37:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:37:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:37:48 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:37:49 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:37:49 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:37:49 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8619MB free_disk=25.078632354736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:37:49 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:37:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:37:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:57 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:37:57 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:37:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:37:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:37:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:37:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:37:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:37:59 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:37:59 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 4b290e1c-9913-40a0-b56a-cff34ac136d5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:38:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:00 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Updating instance_info_cache with network_info: [{"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:38:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-4b290e1c-9913-40a0-b56a-cff34ac136d5" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:38:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:38:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:06 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4969-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:38:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:38:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:38:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:38:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:26 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:38:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "4b290e1c-9913-40a0-b56a-cff34ac136d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:38:27 user nova-compute[71312]: INFO nova.compute.manager [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Terminating instance
Apr 14 06:38:27 user nova-compute[71312]: DEBUG nova.compute.manager [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received event network-vif-unplugged-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] Acquiring lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] No waiting events found dispatching network-vif-unplugged-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG nova.compute.manager [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received event network-vif-unplugged-a60861bc-2377-4a40-87be-e251f3f8e4bb for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:27 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Instance destroyed successfully.
Apr 14 06:38:27 user nova-compute[71312]: DEBUG nova.objects.instance [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lazy-loading 'resources' on Instance uuid 4b290e1c-9913-40a0-b56a-cff34ac136d5 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1376031392',display_name='tempest-VolumesActionsTest-instance-1376031392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1376031392',id=45,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:36:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c26ec94b6b8430c93f18d63ff4991f6',ramdisk_id='',reservation_id='r-teajfei6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1517089725',owner_user_name='tempest-VolumesActionsTest-1517089725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:36:44Z,user_data=None,user_id='ac6e9308389d4a2e82c417129f92b61f',uuid=4b290e1c-9913-40a0-b56a-cff34ac136d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converting VIF {"id": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "address": "fa:16:3e:34:f9:3e", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa60861bc-23", "ovs_interfaceid": "a60861bc-2377-4a40-87be-e251f3f8e4bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=a60861bc-2377-4a40-87be-e251f3f8e4bb,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60861bc-23') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG os_vif [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=a60861bc-2377-4a40-87be-e251f3f8e4bb,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60861bc-23') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa60861bc-23, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:28 user nova-compute[71312]: INFO os_vif [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:f9:3e,bridge_name='br-int',has_traffic_filtering=True,id=a60861bc-2377-4a40-87be-e251f3f8e4bb,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa60861bc-23')
Apr 14 06:38:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Deleting instance files /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5_del
Apr 14 06:38:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Deletion of /opt/stack/data/nova/instances/4b290e1c-9913-40a0-b56a-cff34ac136d5_del complete
Apr 14 06:38:28 user nova-compute[71312]: INFO nova.compute.manager [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 06:38:28 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:38:28 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:38:28 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:38:28 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:38:28 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Took 0.55 seconds to deallocate network for instance.
Apr 14 06:38:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-af71c0c3-7478-4612-83a4-f7a97f91d1c4 req-f9c68e33-2f03-453d-8449-408358d48e98 service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received event network-vif-deleted-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:38:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:38:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:38:28 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:38:28 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:38:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:38:28 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Deleted allocations for instance 4b290e1c-9913-40a0-b56a-cff34ac136d5
Apr 14 06:38:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.736s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:38:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received event network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:38:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] Acquiring lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:38:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:38:29 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] Lock "4b290e1c-9913-40a0-b56a-cff34ac136d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:38:29 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] No waiting events found dispatching network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:38:29 user nova-compute[71312]: WARNING nova.compute.manager [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Received unexpected event network-vif-plugged-a60861bc-2377-4a40-87be-e251f3f8e4bb for instance with vm_state deleted and task_state None.
Apr 14 06:38:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:41 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:42 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681454307.9633787, 4b290e1c-9913-40a0-b56a-cff34ac136d5 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:38:42 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] VM Stopped (Lifecycle Event)
Apr 14 06:38:42 user nova-compute[71312]: DEBUG nova.compute.manager [None req-00e4178b-2c8d-4259-9f39-bd3eb1f31feb None None] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:38:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:38:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:38:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:38:50 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:38:50 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:38:51 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:38:51 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=25.31122589111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:38:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:38:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:38:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:38:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:39:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:39:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:39:00 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:39:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:39:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:39:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:39:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:39:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:04 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:39:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:39:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:39:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:39:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:39:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:39:19 user nova-compute[71312]: INFO nova.compute.claims [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Claim successful on node user
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:39:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.policy [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac6e9308389d4a2e82c417129f92b61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c26ec94b6b8430c93f18d63ff4991f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:39:19 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Creating image(s)
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "/opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "/opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "/opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.140s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "778f57ebc83a64a817f625aae4048c912f015620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk 1073741824 {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620,backing_fmt=raw /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk 1073741824" returned: 0 in 0.056s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "778f57ebc83a64a817f625aae4048c912f015620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/778f57ebc83a64a817f625aae4048c912f015620 --force-share --output=json" returned: 0 in 0.135s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk. size=1073741824 {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 06:39:19 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.virt.disk.api [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Cannot resize image /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk to a smaller size. {{(pid=71312) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.objects.instance [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lazy-loading 'migration_context' on Instance uuid 0eed9fa2-a119-4adf-90ff-2368ee6e8074 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Created local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Ensure instance console log exists: /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Successfully created port: 97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Successfully updated port: 97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquired lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received event network-changed-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.compute.manager [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Refreshing instance network info cache due to event network-changed-97810044-0533-4e35-8f5d-dc6557f28d36. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] Acquiring lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:39:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.network.neutron [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updating instance_info_cache with network_info: [{"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Releasing lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Instance network_info: |[{"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] Acquired lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Refreshing network info cache for port 97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Start _get_guest_xml network_info=[{"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'image_id': '3644c9ad-79f4-4051-9ff8-56e591db88fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:39:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:39:21 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T05:42:28Z,direct_url=<?>,disk_format='qcow2',id=3644c9ad-79f4-4051-9ff8-56e591db88fa,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='c0a2da75cb0e40419466981ce2fc0eb0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T05:42:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-966025992',display_name='tempest-VolumesActionsTest-instance-966025992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-966025992',id=46,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c26ec94b6b8430c93f18d63ff4991f6',ramdisk_id='',reservation_id='r-f5x7ar32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1517089725',owner_user_name='tempest-VolumesActionsTest-1517089725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:39:19Z,user_data=None,user_id='ac6e9308389d4a2e82c417129f92b61f',uuid=0eed9fa2-a119-4adf-90ff-2368ee6e8074,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converting VIF {"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=97810044-0533-4e35-8f5d-dc6557f28d36,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97810044-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.objects.instance [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lazy-loading 'pci_devices' on Instance uuid 0eed9fa2-a119-4adf-90ff-2368ee6e8074 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:39:21 user nova-compute[71312]:   <uuid>0eed9fa2-a119-4adf-90ff-2368ee6e8074</uuid>
Apr 14 06:39:21 user nova-compute[71312]:   <name>instance-0000002e</name>
Apr 14 06:39:21 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:39:21 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:39:21 user nova-compute[71312]:   <metadata>
Apr 14 06:39:21 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:39:21 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:39:21 user nova-compute[71312]:       <nova:name>tempest-VolumesActionsTest-instance-966025992</nova:name>
Apr 14 06:39:21 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:39:21</nova:creationTime>
Apr 14 06:39:21 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:39:21 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:39:21 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:39:21 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:39:21 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:39:21 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:39:21 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:39:21 user nova-compute[71312]:       <nova:owner>
Apr 14 06:39:21 user nova-compute[71312]:         <nova:user uuid="ac6e9308389d4a2e82c417129f92b61f">tempest-VolumesActionsTest-1517089725-project-member</nova:user>
Apr 14 06:39:21 user nova-compute[71312]:         <nova:project uuid="4c26ec94b6b8430c93f18d63ff4991f6">tempest-VolumesActionsTest-1517089725</nova:project>
Apr 14 06:39:21 user nova-compute[71312]:       </nova:owner>
Apr 14 06:39:21 user nova-compute[71312]:       <nova:root type="image" uuid="3644c9ad-79f4-4051-9ff8-56e591db88fa"/>
Apr 14 06:39:21 user nova-compute[71312]:       <nova:ports>
Apr 14 06:39:21 user nova-compute[71312]:         <nova:port uuid="97810044-0533-4e35-8f5d-dc6557f28d36">
Apr 14 06:39:21 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 06:39:21 user nova-compute[71312]:         </nova:port>
Apr 14 06:39:21 user nova-compute[71312]:       </nova:ports>
Apr 14 06:39:21 user nova-compute[71312]:     </nova:instance>
Apr 14 06:39:21 user nova-compute[71312]:   </metadata>
Apr 14 06:39:21 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:39:21 user nova-compute[71312]:     <system>
Apr 14 06:39:21 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:39:21 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:39:21 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:39:21 user nova-compute[71312]:       <entry name="serial">0eed9fa2-a119-4adf-90ff-2368ee6e8074</entry>
Apr 14 06:39:21 user nova-compute[71312]:       <entry name="uuid">0eed9fa2-a119-4adf-90ff-2368ee6e8074</entry>
Apr 14 06:39:21 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:39:21 user nova-compute[71312]:     </system>
Apr 14 06:39:21 user nova-compute[71312]:   </sysinfo>
Apr 14 06:39:21 user nova-compute[71312]:   <os>
Apr 14 06:39:21 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:39:21 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:39:21 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:39:21 user nova-compute[71312]:   </os>
Apr 14 06:39:21 user nova-compute[71312]:   <features>
Apr 14 06:39:21 user nova-compute[71312]:     <acpi/>
Apr 14 06:39:21 user nova-compute[71312]:     <apic/>
Apr 14 06:39:21 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:39:21 user nova-compute[71312]:   </features>
Apr 14 06:39:21 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:39:21 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:39:21 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:39:21 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:39:21 user nova-compute[71312]:   </clock>
Apr 14 06:39:21 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:39:21 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:39:21 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:39:21 user nova-compute[71312]:   </cpu>
Apr 14 06:39:21 user nova-compute[71312]:   <devices>
Apr 14 06:39:21 user nova-compute[71312]:     <disk type="file" device="disk">
Apr 14 06:39:21 user nova-compute[71312]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 06:39:21 user nova-compute[71312]:       <source file="/opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk"/>
Apr 14 06:39:21 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:39:21 user nova-compute[71312]:     </disk>
Apr 14 06:39:21 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:39:21 user nova-compute[71312]:       <mac address="fa:16:3e:b9:20:c6"/>
Apr 14 06:39:21 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:39:21 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:39:21 user nova-compute[71312]:       <target dev="tap97810044-05"/>
Apr 14 06:39:21 user nova-compute[71312]:     </interface>
Apr 14 06:39:21 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:39:21 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/console.log" append="off"/>
Apr 14 06:39:21 user nova-compute[71312]:     </serial>
Apr 14 06:39:21 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:39:21 user nova-compute[71312]:     <video>
Apr 14 06:39:21 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:39:21 user nova-compute[71312]:     </video>
Apr 14 06:39:21 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:39:21 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:39:21 user nova-compute[71312]:     </rng>
Apr 14 06:39:21 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:39:21 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:39:21 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:39:21 user nova-compute[71312]:     </memballoon>
Apr 14 06:39:21 user nova-compute[71312]:   </devices>
Apr 14 06:39:21 user nova-compute[71312]: </domain>
Apr 14 06:39:21 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-966025992',display_name='tempest-VolumesActionsTest-instance-966025992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-966025992',id=46,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c26ec94b6b8430c93f18d63ff4991f6',ramdisk_id='',reservation_id='r-f5x7ar32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1517089725',owner_user_name='tempest-VolumesActionsTest-1517089725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:39:19Z,user_data=None,user_id='ac6e9308389d4a2e82c417129f92b61f',uuid=0eed9fa2-a119-4adf-90ff-2368ee6e8074,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converting VIF {"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=97810044-0533-4e35-8f5d-dc6557f28d36,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97810044-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG os_vif [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=97810044-0533-4e35-8f5d-dc6557f28d36,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97810044-05') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97810044-05, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97810044-05, col_values=(('external_ids', {'iface-id': '97810044-0533-4e35-8f5d-dc6557f28d36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:20:c6', 'vm-uuid': '0eed9fa2-a119-4adf-90ff-2368ee6e8074'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:21 user nova-compute[71312]: INFO os_vif [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=97810044-0533-4e35-8f5d-dc6557f28d36,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97810044-05')
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] No VIF found with MAC fa:16:3e:b9:20:c6, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updated VIF entry in instance network info cache for port 97810044-0533-4e35-8f5d-dc6557f28d36. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG nova.network.neutron [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updating instance_info_cache with network_info: [{"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:39:21 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] Releasing lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:39:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:22 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received event network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:39:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] Acquiring lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:22 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:22 user nova-compute[71312]: DEBUG nova.compute.manager [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] No waiting events found dispatching network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:39:22 user nova-compute[71312]: WARNING nova.compute.manager [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received unexpected event network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 for instance with vm_state building and task_state spawning.
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681454364.8310544, 0eed9fa2-a119-4adf-90ff-2368ee6e8074 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:39:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] VM Resumed (Lifecycle Event)
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:39:24 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Instance spawned successfully.
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:39:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681454364.832407, 0eed9fa2-a119-4adf-90ff-2368ee6e8074 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:39:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] VM Started (Lifecycle Event)
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received event network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] Acquiring lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.compute.manager [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] No waiting events found dispatching network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:39:24 user nova-compute[71312]: WARNING nova.compute.manager [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received unexpected event network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 for instance with vm_state building and task_state spawning.
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:39:24 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:39:24 user nova-compute[71312]: INFO nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Took 5.55 seconds to spawn the instance on the hypervisor.
Apr 14 06:39:24 user nova-compute[71312]: DEBUG nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:39:25 user nova-compute[71312]: INFO nova.compute.manager [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Took 6.08 seconds to build instance.
Apr 14 06:39:25 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.174s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:39:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:39:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:39:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:39:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:39:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:39:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8605MB free_disk=25.290237426757812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:39:52 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:39:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:39:58 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:40:01 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 0eed9fa2-a119-4adf-90ff-2368ee6e8074 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:40:02 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updating instance_info_cache with network_info: [{"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:40:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:40:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:40:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:40:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:40:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:16 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:21 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:40:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:40:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:40:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:36 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:37 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:41 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:44 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:40:51 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:40:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:40:52 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:40:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=25.289031982421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:40:52 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:40:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:56 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:40:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:40:59 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:41:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:41:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:41:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:41:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:41:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:41:01 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:41:01 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid 0eed9fa2-a119-4adf-90ff-2368ee6e8074 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:41:02 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updating instance_info_cache with network_info: [{"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:41:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-0eed9fa2-a119-4adf-90ff-2368ee6e8074" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:41:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:41:06 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:41:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:06 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:41:09 user nova-compute[71312]: INFO nova.compute.manager [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Terminating instance
Apr 14 06:41:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received event network-vif-unplugged-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] Acquiring lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] No waiting events found dispatching network-vif-unplugged-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:41:09 user nova-compute[71312]: DEBUG nova.compute.manager [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received event network-vif-unplugged-97810044-0533-4e35-8f5d-dc6557f28d36 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:41:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Instance destroyed successfully.
Apr 14 06:41:10 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lazy-loading 'resources' on Instance uuid 0eed9fa2-a119-4adf-90ff-2368ee6e8074 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-966025992',display_name='tempest-VolumesActionsTest-instance-966025992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-966025992',id=46,image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:39:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c26ec94b6b8430c93f18d63ff4991f6',ramdisk_id='',reservation_id='r-f5x7ar32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3644c9ad-79f4-4051-9ff8-56e591db88fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1517089725',owner_user_name='tempest-VolumesActionsTest-1517089725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:39:25Z,user_data=None,user_id='ac6e9308389d4a2e82c417129f92b61f',uuid=0eed9fa2-a119-4adf-90ff-2368ee6e8074,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converting VIF {"id": "97810044-0533-4e35-8f5d-dc6557f28d36", "address": "fa:16:3e:b9:20:c6", "network": {"id": "49216dec-e26c-4761-be09-a3fae71b2ef4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1948448435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4c26ec94b6b8430c93f18d63ff4991f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97810044-05", "ovs_interfaceid": "97810044-0533-4e35-8f5d-dc6557f28d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=97810044-0533-4e35-8f5d-dc6557f28d36,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97810044-05') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG os_vif [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=97810044-0533-4e35-8f5d-dc6557f28d36,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97810044-05') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97810044-05, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:41:10 user nova-compute[71312]: INFO os_vif [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=97810044-0533-4e35-8f5d-dc6557f28d36,network=Network(49216dec-e26c-4761-be09-a3fae71b2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97810044-05')
Apr 14 06:41:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Deleting instance files /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074_del
Apr 14 06:41:10 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Deletion of /opt/stack/data/nova/instances/0eed9fa2-a119-4adf-90ff-2368ee6e8074_del complete
Apr 14 06:41:10 user nova-compute[71312]: INFO nova.compute.manager [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 06:41:10 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:41:10 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:41:11 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Took 0.94 seconds to deallocate network for instance.
Apr 14 06:41:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received event network-vif-deleted-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:41:11 user nova-compute[71312]: INFO nova.compute.manager [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Neutron deleted interface 97810044-0533-4e35-8f5d-dc6557f28d36; detaching it from the instance and deleting it from the info cache
Apr 14 06:41:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Detach interface failed, port_id=97810044-0533-4e35-8f5d-dc6557f28d36, reason: Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 could not be found. {{(pid=71312) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:41:11 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Deleted allocations for instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074
Apr 14 06:41:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.908s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received event network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] Acquiring lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] Lock "0eed9fa2-a119-4adf-90ff-2368ee6e8074-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:41:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] No waiting events found dispatching network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:41:11 user nova-compute[71312]: WARNING nova.compute.manager [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Received unexpected event network-vif-plugged-97810044-0533-4e35-8f5d-dc6557f28d36 for instance with vm_state deleted and task_state None.
Apr 14 06:41:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:41:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:41:25 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681454470.1751914, 0eed9fa2-a119-4adf-90ff-2368ee6e8074 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:41:25 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] VM Stopped (Lifecycle Event)
Apr 14 06:41:25 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6fa319c0-d4d6-48a7-9509-ab536ee2592a None None] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:41:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:41:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:41:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:41:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:41:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:41:46 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:41:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:41:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:41:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:41:53 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:41:53 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:41:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:41:54 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:41:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.559406280517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:41:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:41:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:41:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:41:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:41:54 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:41:54 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:41:54 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:41:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:41:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:41:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:42:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:42:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:42:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:42:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:01 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:42:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:42:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:42:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:42:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:42:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:42:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:42:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:42:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:31 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:42:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:42:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:42:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:42:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:42:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:42:55 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:42:55 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:42:56 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:42:56 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:42:56 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.55760955810547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:42:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:42:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:42:56 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:42:56 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:42:56 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:42:56 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:42:56 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:42:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:43:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:43:01 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:02 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:43:02 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:43:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:43:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:43:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:43:07 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:17 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Starting instance... {{(pid=71312) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:43:18 user nova-compute[71312]: INFO nova.compute.claims [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Claim successful on node user
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Start building networks asynchronously for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Allocating IP information in the background. {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] allocate_for_instance() {{(pid=71312) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 06:43:18 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Start building block device mappings for instance. {{(pid=71312) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 06:43:18 user nova-compute[71312]: INFO nova.virt.block_device [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Booting with volume 18c968fc-710d-4734-bfd9-ef5071c5364b at /dev/vda
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.policy [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71312) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG os_brick.utils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6470831d-76c6-4ec0-8db2-ebab65ad59d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d0bca7-c854-4360-bdcd-effc48668bec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2caeef8-f4cb-423d-8fb9-750ad877b5cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[04477b53-1eeb-4ac2-901b-8c7b966b01f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:43:18 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:43:18 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f13025-1dfe-42af-9438-03dddd50407b]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG os_brick.utils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:43:18 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating existing volume attachment record: a1ab36c5-da05-4bb9-993b-36e54e9bc950 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Successfully created port: 1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Successfully updated port: 1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance cache missing network info. {{(pid=71312) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG nova.compute.manager [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing instance network info cache due to event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:43:19 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG nova.network.neutron [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance network_info: |[{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71312) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated VIF entry in instance network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG nova.network.neutron [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:43:20 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Start spawning the instance on the hypervisor. {{(pid=71312) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:43:23 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Creating image(s)
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Ensure instance console log exists: /opt/stack/data/nova/instances/c456cdfd-6989-4fcb-a60b-cbc8cc592f43/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Start _get_guest_xml network_info=[{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'a1ab36c5-da05-4bb9-993b-36e54e9bc950', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEBdXrRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c456cdfd-6989-4fcb-a60b-cbc8cc592f43', 'attached_at': '', 'detached_at': '', 'volume_id': '18c968fc-710d-4734-bfd9-ef5071c5364b', 'serial': '18c968fc-710d-4734-bfd9-ef5071c5364b'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:43:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:43:23 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEBdXrRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:43:23 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:43:23 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:43:23 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ea8e1-6b94-423c-b50e-e71772c38600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:43:23 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8df969-c91f-4215-911f-5ff01b345cc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b] added
Apr 14 06:43:23 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fcf5d7-804a-41b5-8881-91621c9fb4f1]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b24605-3fca-42c5-854e-0b0f52ae9dc5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEBdXrRu {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEBdXrRu" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66dc272-a0c7-4392-8915-b7dcc3cd9173]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VEBdXrRu'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5ddec2-408b-41d5-8e08-2b83152ce9e4]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2879b20e-cdcd-4b0d-9865-84c4eb9b1983]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:43:23 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:43:23 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:43:23 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 06:43:23 user nova-compute[71312]: 
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b81c13b-4a45-4301-8473-8bde60a7ccf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260]
Apr 14 06:43:23 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260] successful.
Apr 14 06:43:23 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd9d594-2759-47fc-8029-227ba4cf3d17]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d30db-116c-4b8d-8500-1f1287a7c147]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)
Apr 14 06:43:23 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)
Apr 14 06:43:23 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8425d222-4a64-4df6-bc03-480064eeb7e0]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:43:23 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEBdXrRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26139633038636362', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139633038636362', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-502729280',display_name='tempest-TestShelveInstance-server-502729280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-502729280',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs1znS8wdd1kcIr9Yz2SWdAc4SAXfKNKRmXHNZYoNVZ42v7a1PiR3v0nEJS6l4GXfjbbAkPUJOxugMIERB4Y9v+RLgB9bXsarGFK8hQyzHoBdnf+HGGWrHMzSVajIRcwg==',key_name='tempest-TestShelveInstance-1686517600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f236d920caec41629c6f9961bd5a9e05',ramdisk_id='',reservation_id='r-srulkqz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-536046863',owner_user_name='tempest-TestShelveInstance-536046863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:43:19Z,user_data=None,user_id='9ac336d9af104cc9b1d47595b06a5fd6',uuid=c456cdfd-6989-4fcb-a60b-cbc8cc592f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converting VIF {"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.objects.instance [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'pci_devices' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:43:24 user nova-compute[71312]:   <uuid>c456cdfd-6989-4fcb-a60b-cbc8cc592f43</uuid>
Apr 14 06:43:24 user nova-compute[71312]:   <name>instance-0000002f</name>
Apr 14 06:43:24 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:43:24 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:43:24 user nova-compute[71312]:   <metadata>
Apr 14 06:43:24 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:43:24 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:43:24 user nova-compute[71312]:       <nova:name>tempest-TestShelveInstance-server-502729280</nova:name>
Apr 14 06:43:24 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:43:23</nova:creationTime>
Apr 14 06:43:24 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:43:24 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:43:24 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:43:24 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:43:24 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:43:24 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:43:24 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:43:24 user nova-compute[71312]:       <nova:owner>
Apr 14 06:43:24 user nova-compute[71312]:         <nova:user uuid="9ac336d9af104cc9b1d47595b06a5fd6">tempest-TestShelveInstance-536046863-project-member</nova:user>
Apr 14 06:43:24 user nova-compute[71312]:         <nova:project uuid="f236d920caec41629c6f9961bd5a9e05">tempest-TestShelveInstance-536046863</nova:project>
Apr 14 06:43:24 user nova-compute[71312]:       </nova:owner>
Apr 14 06:43:24 user nova-compute[71312]:       <nova:ports>
Apr 14 06:43:24 user nova-compute[71312]:         <nova:port uuid="1f36038c-c21c-4283-8e87-62f069837cc4">
Apr 14 06:43:24 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 06:43:24 user nova-compute[71312]:         </nova:port>
Apr 14 06:43:24 user nova-compute[71312]:       </nova:ports>
Apr 14 06:43:24 user nova-compute[71312]:     </nova:instance>
Apr 14 06:43:24 user nova-compute[71312]:   </metadata>
Apr 14 06:43:24 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:43:24 user nova-compute[71312]:     <system>
Apr 14 06:43:24 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:43:24 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:43:24 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:43:24 user nova-compute[71312]:       <entry name="serial">c456cdfd-6989-4fcb-a60b-cbc8cc592f43</entry>
Apr 14 06:43:24 user nova-compute[71312]:       <entry name="uuid">c456cdfd-6989-4fcb-a60b-cbc8cc592f43</entry>
Apr 14 06:43:24 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:43:24 user nova-compute[71312]:     </system>
Apr 14 06:43:24 user nova-compute[71312]:   </sysinfo>
Apr 14 06:43:24 user nova-compute[71312]:   <os>
Apr 14 06:43:24 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:43:24 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:43:24 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:43:24 user nova-compute[71312]:   </os>
Apr 14 06:43:24 user nova-compute[71312]:   <features>
Apr 14 06:43:24 user nova-compute[71312]:     <acpi/>
Apr 14 06:43:24 user nova-compute[71312]:     <apic/>
Apr 14 06:43:24 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:43:24 user nova-compute[71312]:   </features>
Apr 14 06:43:24 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:43:24 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:43:24 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:43:24 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:43:24 user nova-compute[71312]:   </clock>
Apr 14 06:43:24 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:43:24 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:43:24 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:43:24 user nova-compute[71312]:   </cpu>
Apr 14 06:43:24 user nova-compute[71312]:   <devices>
Apr 14 06:43:24 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:43:24 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:43:24 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 06:43:24 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:43:24 user nova-compute[71312]:       <serial>18c968fc-710d-4734-bfd9-ef5071c5364b</serial>
Apr 14 06:43:24 user nova-compute[71312]:     </disk>
Apr 14 06:43:24 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:43:24 user nova-compute[71312]:       <mac address="fa:16:3e:6d:94:57"/>
Apr 14 06:43:24 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:43:24 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:43:24 user nova-compute[71312]:       <target dev="tap1f36038c-c2"/>
Apr 14 06:43:24 user nova-compute[71312]:     </interface>
Apr 14 06:43:24 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:43:24 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/c456cdfd-6989-4fcb-a60b-cbc8cc592f43/console.log" append="off"/>
Apr 14 06:43:24 user nova-compute[71312]:     </serial>
Apr 14 06:43:24 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:43:24 user nova-compute[71312]:     <video>
Apr 14 06:43:24 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:43:24 user nova-compute[71312]:     </video>
Apr 14 06:43:24 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:43:24 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:43:24 user nova-compute[71312]:     </rng>
Apr 14 06:43:24 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:43:24 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:43:24 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:43:24 user nova-compute[71312]:     </memballoon>
Apr 14 06:43:24 user nova-compute[71312]:   </devices>
Apr 14 06:43:24 user nova-compute[71312]: </domain>
Apr 14 06:43:24 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-502729280',display_name='tempest-TestShelveInstance-server-502729280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-502729280',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs1znS8wdd1kcIr9Yz2SWdAc4SAXfKNKRmXHNZYoNVZ42v7a1PiR3v0nEJS6l4GXfjbbAkPUJOxugMIERB4Y9v+RLgB9bXsarGFK8hQyzHoBdnf+HGGWrHMzSVajIRcwg==',key_name='tempest-TestShelveInstance-1686517600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f236d920caec41629c6f9961bd5a9e05',ramdisk_id='',reservation_id='r-srulkqz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-536046863',owner_user_name='tempest-TestShelveInstance-536046863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T06:43:19Z,user_data=None,user_id='9ac336d9af104cc9b1d47595b06a5fd6',uuid=c456cdfd-6989-4fcb-a60b-cbc8cc592f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converting VIF {"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG os_vif [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f36038c-c2, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f36038c-c2, col_values=(('external_ids', {'iface-id': '1f36038c-c21c-4283-8e87-62f069837cc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:94:57', 'vm-uuid': 'c456cdfd-6989-4fcb-a60b-cbc8cc592f43'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:24 user nova-compute[71312]: INFO os_vif [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2')
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:43:24 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] No VIF found with MAC fa:16:3e:6d:94:57, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:43:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:43:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:43:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:43:26 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:43:26 user nova-compute[71312]: DEBUG nova.compute.manager [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:43:26 user nova-compute[71312]: WARNING nova.compute.manager [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state building and task_state spawning.
Apr 14 06:43:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:26 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:27 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681454608.0242107, c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:43:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] VM Resumed (Lifecycle Event)
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:43:28 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance spawned successfully.
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Found default for hw_cdrom_bus of ide {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Found default for hw_disk_bus of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Found default for hw_input_bus of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Found default for hw_pointer_model of None {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Found default for hw_video_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Found default for hw_vif_model of virtio {{(pid=71312) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 06:43:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681454608.0273528, c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:43:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] VM Started (Lifecycle Event)
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:43:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:43:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Took 4.88 seconds to spawn the instance on the hypervisor.
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:43:28 user nova-compute[71312]: INFO nova.compute.manager [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Took 10.04 seconds to build instance.
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:43:28 user nova-compute[71312]: DEBUG nova.compute.manager [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:43:28 user nova-compute[71312]: WARNING nova.compute.manager [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state None.
Apr 14 06:43:28 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.135s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:43:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:32 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:36 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:43:36 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:43:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:43:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:43:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:43:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:43:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:42 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:43 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:47 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:47 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:43:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:43:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:43:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:43:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:43:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:43:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:43:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:43:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:43:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:43:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:43:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.54690933227539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:43:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:43:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:03 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:44:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:44:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:44:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:44:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:44:07 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:44:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:44:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:44:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:44:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:44:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:10 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:32 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:32 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Triggering sync for uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 06:44:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:44:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:44:32 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:44:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:48 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:44:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:44:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:44:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:44:57 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:44:57 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:44:57 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:44:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:44:58 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=25.546310424804688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:44:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:44:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:44:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:44:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:44:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:45:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:45:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:45:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:45:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:45:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:45:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:45:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:45:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:45:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:45:08 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:45:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:10 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:45:10 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:45:10 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing instance network info cache due to event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:11 user nova-compute[71312]: INFO nova.compute.manager [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Shelve offloading
Apr 14 06:45:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated VIF entry in instance network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.network.neutron [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.compute.manager [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:45:11 user nova-compute[71312]: WARNING nova.compute.manager [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state shelving.
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:11 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance destroyed successfully.
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:45:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance destroyed successfully.
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'resources' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T06:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-502729280',display_name='tempest-TestShelveInstance-server-502729280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-502729280',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs1znS8wdd1kcIr9Yz2SWdAc4SAXfKNKRmXHNZYoNVZ42v7a1PiR3v0nEJS6l4GXfjbbAkPUJOxugMIERB4Y9v+RLgB9bXsarGFK8hQyzHoBdnf+HGGWrHMzSVajIRcwg==',key_name='tempest-TestShelveInstance-1686517600',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:43:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f236d920caec41629c6f9961bd5a9e05',ramdisk_id='',reservation_id='r-srulkqz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-536046863',owner_user_name='tempest-TestShelveInstance-536046863-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:43:28Z,user_data=None,user_id='9ac336d9af104cc9b1d47595b06a5fd6',uuid=c456cdfd-6989-4fcb-a60b-cbc8cc592f43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converting VIF {"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_vif [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f36038c-c2, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:45:13 user nova-compute[71312]: INFO os_vif [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2')
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing instance network info cache due to event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEBdXrRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:45:13 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d98fe51-e22a-471b-8058-c97e88495157]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:45:13 user nova-compute[71312]: No targets found.
Apr 14 06:45:13 user nova-compute[71312]: iSNS:
Apr 14 06:45:13 user nova-compute[71312]: No targets found.
Apr 14 06:45:13 user nova-compute[71312]: STATIC:
Apr 14 06:45:13 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b
Apr 14 06:45:13 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:45:13 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:45:13 user nova-compute[71312]: FIRMWARE:
Apr 14 06:45:13 user nova-compute[71312]: No targets found.
Apr 14 06:45:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:45:13 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:45:13 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ec2cce-f8f2-4948-b422-9f5f194468e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[97245aea-0444-4195-ba45-6c5e4bad7de0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)
Apr 14 06:45:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)
Apr 14 06:45:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49dc25d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fd4230-59f1-4719-b755-d57bd4fc4621]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[214443b5-ee6e-4d28-832e-c9ce47cf93d6]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2e39c2-eec1-4839-92a1-a94cc4dd04ab]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2776b472-f897-458b-8ab5-de27a3124359]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b560df22-3b30-4757-aada-0bf04fa24d80]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[845870d2-b98c-40b4-a757-cba757681840]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260]
Apr 14 06:45:13 user nova-compute[71312]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260] successful.
Apr 14 06:45:13 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[913290d2-5b0f-4bf5-acd7-bbb159dcb6e9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] <== disconnect_volume: return (271ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:45:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Deleting instance files /opt/stack/data/nova/instances/c456cdfd-6989-4fcb-a60b-cbc8cc592f43_del
Apr 14 06:45:13 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Deletion of /opt/stack/data/nova/instances/c456cdfd-6989-4fcb-a60b-cbc8cc592f43_del complete
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:45:13 user nova-compute[71312]: WARNING nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state shelving.
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:45:13 user nova-compute[71312]: WARNING nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state shelving.
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:45:13 user nova-compute[71312]: WARNING nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state shelving.
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:45:13 user nova-compute[71312]: WARNING nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state shelving.
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:45:13 user nova-compute[71312]: WARNING nova.compute.manager [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state shelving.
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated VIF entry in instance network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG nova.network.neutron [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": null, "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1f36038c-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:45:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:45:14 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Deleted allocations for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43
Apr 14 06:45:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:14 user nova-compute[71312]: DEBUG nova.objects.instance [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'numa_topology' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:45:14 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:45:14 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:45:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.092s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.621s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:26 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681454711.9443974, c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:45:26 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] VM Stopped (Lifecycle Event)
Apr 14 06:45:26 user nova-compute[71312]: DEBUG nova.compute.manager [None req-edd96949-b5be-4fad-9405-b38cfe65c5ab None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:45:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:45:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:51 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:45:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:45:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:45:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:45:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:45:58 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:45:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:58 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:45:58 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:45:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:45:59 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:45:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.545269012451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:45:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:45:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:45:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:45:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:45:59 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:45:59 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:45:59 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:45:59 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:46:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:05 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:46:05 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:46:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:46:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:46:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:46:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:46:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:46:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:46:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:46:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:46:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:46:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:46:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:46:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:38 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:48 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:49 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:46:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:46:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:46:53 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:46:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:46:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:46:59 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:00 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:47:00 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:47:00 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:47:01 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:47:01 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:47:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=25.544719696044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:47:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:47:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:47:01 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:47:01 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:47:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:47:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:47:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:47:02 user nova-compute[71312]: INFO nova.compute.manager [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Unshelving
Apr 14 06:47:02 user nova-compute[71312]: INFO nova.virt.block_device [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Booting with volume 18c968fc-710d-4734-bfd9-ef5071c5364b at /dev/vda
Apr 14 06:47:03 user nova-compute[71312]: DEBUG os_brick.utils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99cec3-06b7-44c3-a344-5123adf27146]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:532ef28de81b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c70a19-d148-4cb5-9afb-c315c2d68677]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[20546d48-8456-4351-bf7e-114c2f041188]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb8ebfb-8641-4bae-a1a8-0f6bbc3d56fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Running cmd (subprocess): nvme version {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 'nvme version' failed. Not Retrying. {{(pid=71312) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] nvme not present on system {{(pid=71312) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 06:47:03 user nova-compute[71312]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 06:47:03 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6130f05-393e-429d-b336-6ab1e567b16c]: (4, '') {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71312) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.lightos [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] LIGHTOS: no hostnqn found. {{(pid=71312) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG os_brick.utils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:532ef28de81b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG nova.virt.block_device [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating existing volume attachment record: 450d378d-6063-497a-b6be-65eb3183d043 {{(pid=71312) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 06:47:03 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:47:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:47:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:47:07 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:47:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'pci_requests' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:47:07 user nova-compute[71312]: DEBUG nova.objects.instance [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'numa_topology' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:47:07 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71312) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 06:47:07 user nova-compute[71312]: INFO nova.compute.claims [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Claim successful on node user
Apr 14 06:47:07 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:47:07 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:47:08 user nova-compute[71312]: INFO nova.network.neutron [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating port 1f36038c-c21c-4283-8e87-62f069837cc4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG nova.network.neutron [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Building network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG nova.compute.manager [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing instance network info cache due to event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:47:08 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.network.neutron [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Creating instance directory {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 06:47:09 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Creating image(s)
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Did not create local disks {{(pid=71312) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Ensure instance console log exists: /opt/stack/data/nova/instances/c456cdfd-6989-4fcb-a60b-cbc8cc592f43/console.log {{(pid=71312) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Start _get_guest_xml network_info=[{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '450d378d-6063-497a-b6be-65eb3183d043', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEBdXrRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c456cdfd-6989-4fcb-a60b-cbc8cc592f43', 'attached_at': '', 'detached_at': '', 'volume_id': '18c968fc-710d-4734-bfd9-ef5071c5364b', 'serial': '18c968fc-710d-4734-bfd9-ef5071c5364b'}, 'guest_format': None, 'volume_type': None} {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:47:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:47:09 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71312) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T05:43:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Flavor limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Image limits 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Flavor pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Image pref 0:0:0 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Got 1 possible topologies {{(pid=71312) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.hardware [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71312) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.objects.instance [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'vcpu_model' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Calling os-brick to attach iSCSI Volume {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEBdXrRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:47:09 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:47:09 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:47:09 user nova-compute[71312]: INFO os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a08eaf4-9792-4974-b77f-0f0b3c313d4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 06:47:09 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --interface default --op new {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7d727-5136-4fc4-9763-7111814a82fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b] added\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b] added
Apr 14 06:47:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eb8eb5-135b-43bf-9e86-94bbbb0a73e6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41ef313-70df-4752-8eed-155c66768c05]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEBdXrRu {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEBdXrRu" returned: 0 in 0.022s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf5e6c4-7bdc-4bde-9bb8-72aa9832d62a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VEBdXrRu'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4d9f35-5854-42ec-b2ce-9ae5b21b18e9]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e817ce6-d6b5-4428-8470-c7c5cab1295e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:47:09 user nova-compute[71312]:  {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 06:47:09 user nova-compute[71312]:  {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:47:09 user nova-compute[71312]: WARNING os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 06:47:09 user nova-compute[71312]: 
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --login {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd61089-684a-4259-819d-f65abcb15702]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260]
Apr 14 06:47:09 user nova-compute[71312]: Login to [iface: default, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260] successful.
Apr 14 06:47:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d8e191-73be-4cd6-b7fd-f567331f53a6]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4142860f-80aa-4f1b-8f33-f52a5c902d75]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)
Apr 14 06:47:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)
Apr 14 06:47:09 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Connected to 172.16.0.220:3260 {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71312) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71312) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7edcf5b-c7ca-4c7a-a21a-4b58135b647d]: (4, ('- - 0', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71312) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEBdXrRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71312) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated VIF entry in instance network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG nova.network.neutron [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:47:09 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26139633038636362', 'path': '/dev/sdb'} {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139633038636362', 'path': '/dev/sdb'} {{(pid=71312) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T06:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-502729280',display_name='tempest-TestShelveInstance-server-502729280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-502729280',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1686517600',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:43:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f236d920caec41629c6f9961bd5a9e05',ramdisk_id='',reservation_id='r-srulkqz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-536046863',owner_user_name='tempest-TestShelveInstance-536046863-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:47:03Z,user_data=None,user_id='9ac336d9af104cc9b1d47595b06a5fd6',uuid=c456cdfd-6989-4fcb-a60b-cbc8cc592f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71312) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converting VIF {"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.objects.instance [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'pci_devices' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] End _get_guest_xml xml=<domain type="kvm">
Apr 14 06:47:10 user nova-compute[71312]:   <uuid>c456cdfd-6989-4fcb-a60b-cbc8cc592f43</uuid>
Apr 14 06:47:10 user nova-compute[71312]:   <name>instance-0000002f</name>
Apr 14 06:47:10 user nova-compute[71312]:   <memory>131072</memory>
Apr 14 06:47:10 user nova-compute[71312]:   <vcpu>1</vcpu>
Apr 14 06:47:10 user nova-compute[71312]:   <metadata>
Apr 14 06:47:10 user nova-compute[71312]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 06:47:10 user nova-compute[71312]:       <nova:package version="0.0.0"/>
Apr 14 06:47:10 user nova-compute[71312]:       <nova:name>tempest-TestShelveInstance-server-502729280</nova:name>
Apr 14 06:47:10 user nova-compute[71312]:       <nova:creationTime>2023-04-14 06:47:09</nova:creationTime>
Apr 14 06:47:10 user nova-compute[71312]:       <nova:flavor name="m1.nano">
Apr 14 06:47:10 user nova-compute[71312]:         <nova:memory>128</nova:memory>
Apr 14 06:47:10 user nova-compute[71312]:         <nova:disk>1</nova:disk>
Apr 14 06:47:10 user nova-compute[71312]:         <nova:swap>0</nova:swap>
Apr 14 06:47:10 user nova-compute[71312]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 06:47:10 user nova-compute[71312]:         <nova:vcpus>1</nova:vcpus>
Apr 14 06:47:10 user nova-compute[71312]:       </nova:flavor>
Apr 14 06:47:10 user nova-compute[71312]:       <nova:owner>
Apr 14 06:47:10 user nova-compute[71312]:         <nova:user uuid="9ac336d9af104cc9b1d47595b06a5fd6">tempest-TestShelveInstance-536046863-project-member</nova:user>
Apr 14 06:47:10 user nova-compute[71312]:         <nova:project uuid="f236d920caec41629c6f9961bd5a9e05">tempest-TestShelveInstance-536046863</nova:project>
Apr 14 06:47:10 user nova-compute[71312]:       </nova:owner>
Apr 14 06:47:10 user nova-compute[71312]:       <nova:ports>
Apr 14 06:47:10 user nova-compute[71312]:         <nova:port uuid="1f36038c-c21c-4283-8e87-62f069837cc4">
Apr 14 06:47:10 user nova-compute[71312]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 06:47:10 user nova-compute[71312]:         </nova:port>
Apr 14 06:47:10 user nova-compute[71312]:       </nova:ports>
Apr 14 06:47:10 user nova-compute[71312]:     </nova:instance>
Apr 14 06:47:10 user nova-compute[71312]:   </metadata>
Apr 14 06:47:10 user nova-compute[71312]:   <sysinfo type="smbios">
Apr 14 06:47:10 user nova-compute[71312]:     <system>
Apr 14 06:47:10 user nova-compute[71312]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 06:47:10 user nova-compute[71312]:       <entry name="product">OpenStack Nova</entry>
Apr 14 06:47:10 user nova-compute[71312]:       <entry name="version">0.0.0</entry>
Apr 14 06:47:10 user nova-compute[71312]:       <entry name="serial">c456cdfd-6989-4fcb-a60b-cbc8cc592f43</entry>
Apr 14 06:47:10 user nova-compute[71312]:       <entry name="uuid">c456cdfd-6989-4fcb-a60b-cbc8cc592f43</entry>
Apr 14 06:47:10 user nova-compute[71312]:       <entry name="family">Virtual Machine</entry>
Apr 14 06:47:10 user nova-compute[71312]:     </system>
Apr 14 06:47:10 user nova-compute[71312]:   </sysinfo>
Apr 14 06:47:10 user nova-compute[71312]:   <os>
Apr 14 06:47:10 user nova-compute[71312]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 06:47:10 user nova-compute[71312]:     <boot dev="hd"/>
Apr 14 06:47:10 user nova-compute[71312]:     <smbios mode="sysinfo"/>
Apr 14 06:47:10 user nova-compute[71312]:   </os>
Apr 14 06:47:10 user nova-compute[71312]:   <features>
Apr 14 06:47:10 user nova-compute[71312]:     <acpi/>
Apr 14 06:47:10 user nova-compute[71312]:     <apic/>
Apr 14 06:47:10 user nova-compute[71312]:     <vmcoreinfo/>
Apr 14 06:47:10 user nova-compute[71312]:   </features>
Apr 14 06:47:10 user nova-compute[71312]:   <clock offset="utc">
Apr 14 06:47:10 user nova-compute[71312]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 06:47:10 user nova-compute[71312]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 06:47:10 user nova-compute[71312]:     <timer name="hpet" present="no"/>
Apr 14 06:47:10 user nova-compute[71312]:   </clock>
Apr 14 06:47:10 user nova-compute[71312]:   <cpu mode="custom" match="exact">
Apr 14 06:47:10 user nova-compute[71312]:     <model>Nehalem</model>
Apr 14 06:47:10 user nova-compute[71312]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 06:47:10 user nova-compute[71312]:   </cpu>
Apr 14 06:47:10 user nova-compute[71312]:   <devices>
Apr 14 06:47:10 user nova-compute[71312]:     <disk type="block" device="disk">
Apr 14 06:47:10 user nova-compute[71312]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 06:47:10 user nova-compute[71312]:       <source dev="/dev/sdb"/>
Apr 14 06:47:10 user nova-compute[71312]:       <target dev="vda" bus="virtio"/>
Apr 14 06:47:10 user nova-compute[71312]:       <serial>18c968fc-710d-4734-bfd9-ef5071c5364b</serial>
Apr 14 06:47:10 user nova-compute[71312]:     </disk>
Apr 14 06:47:10 user nova-compute[71312]:     <interface type="ethernet">
Apr 14 06:47:10 user nova-compute[71312]:       <mac address="fa:16:3e:6d:94:57"/>
Apr 14 06:47:10 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:47:10 user nova-compute[71312]:       <mtu size="1442"/>
Apr 14 06:47:10 user nova-compute[71312]:       <target dev="tap1f36038c-c2"/>
Apr 14 06:47:10 user nova-compute[71312]:     </interface>
Apr 14 06:47:10 user nova-compute[71312]:     <serial type="pty">
Apr 14 06:47:10 user nova-compute[71312]:       <log file="/opt/stack/data/nova/instances/c456cdfd-6989-4fcb-a60b-cbc8cc592f43/console.log" append="off"/>
Apr 14 06:47:10 user nova-compute[71312]:     </serial>
Apr 14 06:47:10 user nova-compute[71312]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 06:47:10 user nova-compute[71312]:     <video>
Apr 14 06:47:10 user nova-compute[71312]:       <model type="virtio"/>
Apr 14 06:47:10 user nova-compute[71312]:     </video>
Apr 14 06:47:10 user nova-compute[71312]:     <rng model="virtio">
Apr 14 06:47:10 user nova-compute[71312]:       <backend model="random">/dev/urandom</backend>
Apr 14 06:47:10 user nova-compute[71312]:     </rng>
Apr 14 06:47:10 user nova-compute[71312]:     <controller type="usb" index="0" model="none"/>
Apr 14 06:47:10 user nova-compute[71312]:     <memballoon model="virtio">
Apr 14 06:47:10 user nova-compute[71312]:       <stats period="10"/>
Apr 14 06:47:10 user nova-compute[71312]:     </memballoon>
Apr 14 06:47:10 user nova-compute[71312]:   </devices>
Apr 14 06:47:10 user nova-compute[71312]: </domain>
Apr 14 06:47:10 user nova-compute[71312]:  {{(pid=71312) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T06:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-502729280',display_name='tempest-TestShelveInstance-server-502729280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-502729280',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1686517600',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:43:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f236d920caec41629c6f9961bd5a9e05',ramdisk_id='',reservation_id='r-srulkqz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-536046863',owner_user_name='tempest-TestShelveInstance-536046863-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:47:03Z,user_data=None,user_id='9ac336d9af104cc9b1d47595b06a5fd6',uuid=c456cdfd-6989-4fcb-a60b-cbc8cc592f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converting VIF {"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG os_vif [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f36038c-c2, may_exist=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f36038c-c2, col_values=(('external_ids', {'iface-id': '1f36038c-c21c-4283-8e87-62f069837cc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:94:57', 'vm-uuid': 'c456cdfd-6989-4fcb-a60b-cbc8cc592f43'}),)) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:10 user nova-compute[71312]: INFO os_vif [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2')
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] No BDM found with device name vda, not building metadata. {{(pid=71312) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 06:47:10 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] No VIF found with MAC fa:16:3e:6d:94:57, not building metadata {{(pid=71312) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 06:47:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:47:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:47:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:47:11 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:47:11 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:47:11 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG nova.compute.manager [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:47:12 user nova-compute[71312]: WARNING nova.compute.manager [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 06:47:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:47:12 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:13 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681454834.1801398, c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => Resumed> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:47:14 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] VM Resumed (Lifecycle Event)
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance event wait completed in 0 seconds for  {{(pid=71312) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Guest created on hypervisor {{(pid=71312) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 06:47:14 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance spawned successfully.
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:47:14 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.virt.driver [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] Emitting event <LifecycleEvent: 1681454834.1824253, c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => Started> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:47:14 user nova-compute[71312]: INFO nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] VM Started (Lifecycle Event)
Apr 14 06:47:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.408s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-a14425cf-bcd7-4b9d-9358-e53135cc01fe None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71312) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:47:14 user nova-compute[71312]: DEBUG nova.compute.manager [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:47:14 user nova-compute[71312]: WARNING nova.compute.manager [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state None.
Apr 14 06:47:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:18 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:28 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:33 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:47:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:47:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:47:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:47:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:43 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:52 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:47:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:47:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:47:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:47:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:47:55 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:47:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:00 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:48:01 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:48:01 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:48:01 user nova-compute[71312]: DEBUG nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71312) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 06:48:02 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:48:02 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:48:02 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=25.543113708496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71312) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:48:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:48:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:48:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:48:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:48:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:48:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:07 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:07 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:48:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:48:11 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:11 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71312) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 06:48:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:48:13 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:48:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:48:13 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:48:13 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Forcefully refreshing network info cache for instance {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 06:48:13 user nova-compute[71312]: DEBUG nova.objects.instance [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lazy-loading 'info_cache' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:48:14 user nova-compute[71312]: DEBUG nova.network.neutron [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:48:14 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:48:14 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated the network info_cache for instance {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 06:48:14 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:48:21 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:23 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:37 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Cleaning up deleted instances {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 06:48:37 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] There are 0 instances to clean {{(pid=71312) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 06:48:40 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:48:45 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:48:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:48:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:48:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:48:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:48:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:48:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:53 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:48:54 user nova-compute[71312]: INFO nova.compute.manager [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Terminating instance
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Start destroying the instance on the hypervisor. {{(pid=71312) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing instance network info cache due to event network-changed-1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] Acquiring lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] Acquired lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.network.neutron [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Refreshing network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.compute.manager [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-unplugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with task_state deleting. {{(pid=71312) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.network.neutron [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updated VIF entry in instance network info cache for port 1f36038c-c21c-4283-8e87-62f069837cc4. {{(pid=71312) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.network.neutron [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [{"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] Releasing lock "refresh_cache-c456cdfd-6989-4fcb-a60b-cbc8cc592f43" {{(pid=71312) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:54 user nova-compute[71312]: INFO nova.virt.libvirt.driver [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Instance destroyed successfully.
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.objects.instance [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'resources' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=71312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.vif [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T06:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-502729280',display_name='tempest-TestShelveInstance-server-502729280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-502729280',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs1znS8wdd1kcIr9Yz2SWdAc4SAXfKNKRmXHNZYoNVZ42v7a1PiR3v0nEJS6l4GXfjbbAkPUJOxugMIERB4Y9v+RLgB9bXsarGFK8hQyzHoBdnf+HGGWrHMzSVajIRcwg==',key_name='tempest-TestShelveInstance-1686517600',keypairs=<?>,launch_index=0,launched_at=2023-04-14T06:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f236d920caec41629c6f9961bd5a9e05',ramdisk_id='',reservation_id='r-srulkqz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-536046863',owner_user_name='tempest-TestShelveInstance-536046863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T06:47:14Z,user_data=None,user_id='9ac336d9af104cc9b1d47595b06a5fd6',uuid=c456cdfd-6989-4fcb-a60b-cbc8cc592f43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converting VIF {"id": "1f36038c-c21c-4283-8e87-62f069837cc4", "address": "fa:16:3e:6d:94:57", "network": {"id": "d5bcea10-de7e-4537-9435-c1b35870e5d3", "bridge": "br-int", "label": "tempest-TestShelveInstance-2104484757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f236d920caec41629c6f9961bd5a9e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f36038c-c2", "ovs_interfaceid": "1f36038c-c21c-4283-8e87-62f069837cc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.network.os_vif_util [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_vif [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2') {{(pid=71312) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f36038c-c2, bridge=br-int, if_exists=True) {{(pid=71312) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:48:54 user nova-compute[71312]: INFO os_vif [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:94:57,bridge_name='br-int',has_traffic_filtering=True,id=1f36038c-c21c-4283-8e87-62f069837cc4,network=Network(d5bcea10-de7e-4537-9435-c1b35870e5d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f36038c-c2')
Apr 14 06:48:54 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] calling os-brick to detach iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49ea24c490>, {'target_iqn': 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEBdXrRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 06:48:54 user nova-compute[71312]: WARNING os_brick.initiator.connectors.base [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c0b177-dc5c-41fe-80be-640544320c2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 06:48:54 user nova-compute[71312]: No targets found.
Apr 14 06:48:54 user nova-compute[71312]: iSNS:
Apr 14 06:48:54 user nova-compute[71312]: No targets found.
Apr 14 06:48:54 user nova-compute[71312]: STATIC:
Apr 14 06:48:54 user nova-compute[71312]: Target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b
Apr 14 06:48:54 user nova-compute[71312]:         Portal: 172.16.0.220:3260,-1
Apr 14 06:48:54 user nova-compute[71312]:                 Iface Name: default
Apr 14 06:48:54 user nova-compute[71312]: FIRMWARE:
Apr 14 06:48:54 user nova-compute[71312]: No targets found.
Apr 14 06:48:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 06:48:54 user nova-compute[71312]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 06:48:54 user nova-compute[71312]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71312) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b', 0)] {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e97b8-5b60-478f-8258-8195bfde5f31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d51570-ac60-4bce-b207-f1d4391a2154]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)
Apr 14 06:48:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b (non-flash)
Apr 14 06:48:54 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e42e1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b'): ({'sdb'}, set())}) {{(pid=71312) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Removing single pathed devices sdb {{(pid=71312) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f426f50e-fb0d-42bf-b7ed-24ee18fbb89c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fea4ce-3f68-47c6-9ba2-500f3c4e1d42]: (4, ('ok\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Flushing IO for device /dev/sdb {{(pid=71312) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eeb6bb-79d9-448b-a943-a801800568e5]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71312) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a6bbb6-9a71-4037-b6b1-5558c45da15c]: (4, ('1', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.linuxscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] SCSI volumes sdb have been removed. {{(pid=71312) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ca261b64', '/dev/disk/by-id/scsi-1SCST_BIOca261b64-a9c08ccb5fbd8ce5', '/dev/disk/by-id/scsi-26139633038636362') {{(pid=81359) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[651762bf-5b86-475d-981f-0e313d8fed5e]: (4, None) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b')] {{(pid=71312) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 06:48:54 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39db74b-15b3-4894-8531-927d5a9536dd]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --logout {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[db54ff2c-59eb-4c31-bd0c-d8c0e6c69e6e]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260]
Apr 14 06:48:55 user nova-compute[71312]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b, portal: 172.16.0.220,3260] successful.
Apr 14 06:48:55 user nova-compute[71312]:  stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op delete {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c968fc-710d-4734-bfd9-ef5071c5364b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81359) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo.privsep.daemon [-] privsep: reply[638c9db1-3a47-4381-a445-9c94d7dff10a]: (4, ('', '')) {{(pid=81359) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71312) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.base [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] <== disconnect_volume: return (276ms) None {{(pid=71312) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Disconnected iSCSI Volume {{(pid=71312) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 06:48:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Deleting instance files /opt/stack/data/nova/instances/c456cdfd-6989-4fcb-a60b-cbc8cc592f43_del
Apr 14 06:48:55 user nova-compute[71312]: INFO nova.virt.libvirt.driver [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Deletion of /opt/stack/data/nova/instances/c456cdfd-6989-4fcb-a60b-cbc8cc592f43_del complete
Apr 14 06:48:55 user nova-compute[71312]: INFO nova.compute.manager [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Took 1.11 seconds to destroy the instance on the hypervisor.
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo.service.loopingcall [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71312) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG nova.compute.manager [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Deallocating network for instance {{(pid=71312) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] deallocate_for_instance() {{(pid=71312) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG nova.network.neutron [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Updating instance_info_cache with network_info: [] {{(pid=71312) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 06:48:55 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Took 0.45 seconds to deallocate network for instance.
Apr 14 06:48:55 user nova-compute[71312]: DEBUG nova.compute.manager [req-9f3dbe1b-cf17-4e58-bf23-3cccd0787d7c req-b1e6a82c-7171-4931-9104-f0ff42f6a0be service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-deleted-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:48:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:56 user nova-compute[71312]: INFO nova.compute.manager [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Took 0.76 seconds to detach 1 volumes for instance.
Apr 14 06:48:56 user nova-compute[71312]: DEBUG nova.compute.manager [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Deleting volume: 18c968fc-710d-4734-bfd9-ef5071c5364b {{(pid=71312) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] Acquiring lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG nova.compute.manager [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] No waiting events found dispatching network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 {{(pid=71312) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 06:48:56 user nova-compute[71312]: WARNING nova.compute.manager [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Received unexpected event network-vif-plugged-1f36038c-c21c-4283-8e87-62f069837cc4 for instance with vm_state active and task_state deleting.
Apr 14 06:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:48:56 user nova-compute[71312]: INFO nova.scheduler.client.report [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Deleted allocations for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43
Apr 14 06:48:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:48:56 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "c456cdfd-6989-4fcb-a60b-cbc8cc592f43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.711s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:48:58 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:48:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:01 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:02 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:49:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:49:02 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:49:02 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:49:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:49:03 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.53447723388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing inventories for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating ProviderTree inventory for provider e19fba5b-1054-4428-a84f-a1d3a8496382 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Updating inventory in ProviderTree for provider e19fba5b-1054-4428-a84f-a1d3a8496382 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing aggregate associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, aggregates: None {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Refreshing trait associations for resource provider e19fba5b-1054-4428-a84f-a1d3a8496382, traits: COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=71312) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:49:03 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:49:04 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:08 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:08 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:49:09 user nova-compute[71312]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681454934.7675753, c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => Stopped> {{(pid=71312) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 06:49:09 user nova-compute[71312]: INFO nova.compute.manager [-] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] VM Stopped (Lifecycle Event)
Apr 14 06:49:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-b8716a10-c073-48e0-a070-fd11ea4dd330 None None] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Checking state {{(pid=71312) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 06:49:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:49:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:49:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:49:09 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:13 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:14 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:49:15 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:49:18 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:19 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:24 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:29 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:34 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:49:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:49:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:49:39 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:44 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:46 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:49 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:50 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:50 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:54 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:55 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:56 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:57 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:49:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:49:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:49:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:49:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:49:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:49:59 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:50:03 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:50:04 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:50:04 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:50:04 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=71312) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:50:05 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:50:05 user nova-compute[71312]: WARNING nova.virt.libvirt.driver [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 06:50:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=25.53292465209961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71312) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71312) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG nova.compute.provider_tree [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed in ProviderTree for provider: e19fba5b-1054-4428-a84f-a1d3a8496382 {{(pid=71312) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG nova.scheduler.client.report [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Inventory has not changed for provider e19fba5b-1054-4428-a84f-a1d3a8496382 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71312) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG nova.compute.resource_tracker [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Compute_service record updated for user:user {{(pid=71312) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 06:50:05 user nova-compute[71312]: DEBUG oslo_concurrency.lockutils [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=71312) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 06:50:09 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:50:09 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71312) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 06:50:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:50:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:50:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71312) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 06:50:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:50:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71312) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 06:50:10 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:50:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:50:15 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:50:15 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:50:16 user nova-compute[71312]: DEBUG oslo_service.periodic_task [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71312) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 06:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Starting heal instance info cache {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 06:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Rebuilding the list of instances to heal {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 06:50:16 user nova-compute[71312]: DEBUG nova.compute.manager [None req-f35b1f76-ba46-4242-9a33-5ff1b67e70f3 None None] Didn't find any instances for network info cache update. {{(pid=71312) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 06:50:20 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 06:50:25 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:50:30 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 06:50:35 user nova-compute[71312]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71312) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}